Measurement-induced improvement in anxiety: Mean shifts with repeated assessment.
Abstract
Some personality test scores improve on retest. Three studies investigated the role of meaning change in producing this phenomenon. In Study 1 multiple versions of a Manifest Anxiety Scale were administered, with counterbalanced item orders. It was found that measurement-induced improvement (a) occurred within a test as well as between test and retest, (b) was unaffected by participants' anxiety scores, and (c) occurred even when the retest contained different items than the first test. Studies 2 and 3 found that as respondents experience more of a test, they are better able to discern its meaning and to use that meaning to interpret an item. These findings indicate that mean shifts in answers from test to retest also occur within a test along with context-induced shifts in meaning.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Knowles et al. found a decrease in anxiety scores from test to retest and a decrease for later items even within a test.
“Knowles et al. found a decrease in anxiety scores from test to retest and a decrease for later items even within a test.”
From Common Factors of Meditation, Focusing, and Cognitive Behavioral Therapy: Longitudinal Relation of Self-Report Measures to Worry, Depressive, and Obsessive-Compulsive Symptoms Among Nonclinical Students (2015) · cites this paper as Knowles et al. 1996
One plausible explanation for the decreases in symptoms is 'meaning change' induced by the exposure to symptom items.
“One plausible explanation for these decreases is “meaning change” induced by the exposure to symptom items (Knowles et al. 1996).”
From Common Factors of Meditation, Focusing, and Cognitive Behavioral Therapy: Longitudinal Relation of Self-Report Measures to Worry, Depressive, and Obsessive-Compulsive Symptoms Among Nonclinical Students (2015) · cites this paper as Knowles et al. 1996
They found that the experience of answering items changed the understanding of the constructs and meaning of single items in light of those constructs.
“They found that the experience of answering items changed the understanding of the constructs and meaning of single items in light of those constructs.”
From Common Factors of Meditation, Focusing, and Cognitive Behavioral Therapy: Longitudinal Relation of Self-Report Measures to Worry, Depressive, and Obsessive-Compulsive Symptoms Among Nonclinical Students (2015) · cites this paper as Knowles et al. 1996
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Sorted by citations
The over-claiming technique: Measuring self-enhancement independent of ability.
Paulhus, D. L., Harms, P. D., Bruce, M. N., & Lysy, D. C. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.84.4.890 · Cited by 521 · see citing works
Initial elevation bias in subjective reports
Shrout, P. E., Stadler, G., Lane, S. P., McClure, M. J., Jackson, G. L., Clavél, F. D., Iida, M., Gleason, M. E. J., Xu, J. H., & Bolger, N. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1712277115 · Cited by 190 · see citing works
“, shifts in a single measurement session, within a single instrument, where participants’ responses to items presented early are more extreme than items presented later (1).”
BackgroundStöber, J., & Bittencourt, J. (1998) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(98)00031-x · Cited by 162 · see citing works
Measuring Four Perspectives of Justice Sensitivity With Two Items Each
Baumert, A., Beierlein, C., Schmitt, M., Kemper, C. J., Kovaleva, A., Liebig, S., & Rammstedt, B. (2013) · Journal of Personality Assessment · doi:10.1080/00223891.2013.836526 · Cited by 94 · see citing works
“This is crucial because the placement of items within a scale has been shown to affect item characteristics (Knowles & Condon, 2000; Schwarz, 1999), including item means (Knowles et al., 1996).”
BackgroundA short form of the worry domains questionnaire: construction and factorial validation
Stöber, J., & Joormann, J. (2001) · Personality and Individual Differences · doi:10.1016/s0191-8869(00)00163-x · Cited by 73 · see citing works
“The starting point was the seminal work of Liebert and Morris (1967), who were the first to discriminate between a cognitive component (worry) and a physiological component (emotionality) in test anxiety.”
BackgroundBias in Self-Reports: An Initial Elevation Phenomenon
Anvari, F., Efendić, E., Olsen, J., Arslan, R. C., Elson, M., & Schneider, I. K. (2022) · Social Psychological and Personality Science · doi:10.1177/19485506221129160 · Cited by 86 · see citing works
“…particularly for negative feelings such as anxiety and depression (e.g., Brantley et al., 1988; French & Sutton, 2010; Ganzach & Bulmash, 2021; Knowles et al., 1996; Lucas et al., 1999; Milich et al., 1980; Neprash, 1936; Piacentini et al., 1999; Reynolds et al., 2016; Ribera et al., 1996;…”
BackgroundDuan, N., Alegria, M. M., CANINO, G. J., McGuire, T. G., & Takeuchi, D. T. (2006) · Health Services Research · doi:10.1111/j.1475-6773.2006.00618.x · Cited by 68 · see citing works
“…items placed in the latter segment of a survey instrument are affected by experience gained from earlier segments of the survey (Kessler et al. 1994, 1998, 2000; Knowles et al. 1996; Vega et al. 1998; Lucas et al. 1999; Piacentini et al. 1999; Kessler and Merikangas 2004; Kessler and Ustun 2004).”
BackgroundEisele, G. V., Vachon, H., Lafit, G., Tuyaerts, D., Houben, M., Kuppens, P., Myin‐Germeys, I., & Viechtbauer, W. (2022) · Psychological Assessment · doi:10.1037/pas0001177 · Cited by 64 · see citing works
Arslan, R. C., Reitz, A. K., Driebe, J. C., Gerlach, T. M., & Penke, L. (2020) · Psychological Methods · doi:10.1037/met0000294 · Cited by 60 · see citing works
“An “attenuation effect,” in which later responses are biased downward because of measurement reactivity, where the act of measurement affected people's later responses, and a selection bias in which people are more likely to enroll in a study if, for example, they are particularly anxious, and then regress to the mean…”
BackgroundThe effect of estrogen synthesis inhibition on hippocampal memory.
Bayer, J., Rune, G., Schultz, H., Tobia, M. J., Mebes, I., Katzler, O., & Sommer, T. (2015) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2015.03.011 · Cited by 53 · see citing works
Schermelleh-Engel, K., Keith, N., Moosbrugger, H., & Hodapp, V. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.2.198 · Cited by 54 · see citing works
Taylor, J. A., Kwan-Gett, T. S., & McMahon, E. M. (2003) · PEDIATRICS · doi:10.1542/peds.111.5.e548 · Cited by 47 · see citing works
Kawakami, N., Tran, T. T. T., Watanabe, K., Imamura, K., Nguyen, H. T., Sasaki, N., Kuribayashi, K., Sakuraya, A., Nguyen, Q. T., Nguyen, N. T., et al. (2020) · PLoS ONE · doi:10.1371/journal.pone.0233119 · Cited by 40 · see citing works
“Repeated surveys have been reported to result in attenuated responses to anxiety symptoms of respondents [49], which may affect the finding of the present study.”
van Starrenburg, M. L. A., Kuijpers, R., Kleinjan, M., Hutschemaekers, G. J. M., & Engels, R. C. M. E. (2016) · Prevention Science · doi:10.1007/s11121-016-0725-5 · Cited by 38 · see citing works
“Second, since the children completed the questionnaires about their anxiety weekly, a measurementinduced improvement could occur (Knowles et al. 1996).”
Kishita, N., Muto, T., Ohtsuki, T., & Barnes-Holmes, D. (2014) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2013.12.001 · Cited by 36 · see citing works
HAUSKNECHT, J. P. (2010) · Personnel Psychology · doi:10.1111/j.1744-6570.2010.01171.x · Cited by 35 · see citing works
Hartig, J., Hölzel, B. K., & Moosbrugger, H. (2007) · Multivariate Behavioral Research · doi:10.1080/00273170701341266 · Cited by 30 · see citing works
“Although Knowles et al. (1996) found a general decreasing trend of item scores, independent of the participants’ overall score, Knowles (1988) found a decreasing trend in item scores only for low-scoring participants; Hamilton and Shuminsky (1990) did not find any systematic trends in item means.”
ResultDo drivers become less risk-prone after answering a questionnaire on risky driving behaviour?
Falk, B. (2009) · Accident Analysis & Prevention · doi:10.1016/j.aap.2009.08.003 · Cited by 19 · see citing works
Retaking Employment Tests: What We Know and What We Still Need to Know
Iddekinge, C. H. V., & Arnold, J. D. (2017) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-032516-113349 · Cited by 16 · see citing works
Jendryczko, D., Scharfen, J., & Holling, H. (2019) · Journal of Intelligence · doi:10.3390/jintelligence7040022 · Cited by 17 · see citing works
“retesting [30,31] and that a long line of research has been dedicated to the relationship between test anxiety and test performance (see below); however, research on the effect of test anxiety on ability score changes is still missing.”
BackgroundGershuny, B. S., Sher, K. J., Rossy, L. A., & Bishop, A. K. (2000) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(99)00039-x · Cited by 17 · see citing works
Stress and the move into community accommodation
Bramston, P., & Cummins, R. A. (1998) · Journal of Intellectual & Developmental Disability · doi:10.1080/13668259800033781 · Cited by 16 · see citing works
Sugiura, T., & Sugiura, Y. (2015) · Mindfulness · doi:10.1007/s12671-014-0296-0 · Cited by 15 · see citing works
“One plausible explanation for these decreases is “meaning change” induced by the exposure to symptom items (Knowles et al. 1996).”
BackgroundMurdoch, M., Partin, M. R., Vang, D., & Kehle‐Forbes, S. (2018) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/1556264618810302 · Cited by 16 · see citing works
Reclaiming the Value of Assessing Unconscious and Subjective Psychological Experience
Huprich, S. K. (2011) · Journal of Personality Assessment · doi:10.1080/00223891.2010.542531 · Cited by 14 · see citing works
Motivating by measuring motivation? Examining reactivity in a diary study on student motivation
Beymer, P. N., & Robinson, K. A. (2022) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2022.102072 · Cited by 14 · see citing works
Kitamura, T., Sugawara, M., Shima, S., & Toda, M. A. (1999) · Journal of Psychosomatic Obstetrics & Gynecology · doi:10.3109/01674829909075584 · Cited by 12 · see citing works
Self-reports of trauma and dissociation: An examination of context effects
Lemons, P., & Lynn, S. J. (2016) · Consciousness and Cognition · doi:10.1016/j.concog.2016.06.009 · Cited by 11 · see citing works
Murdoch, M., Kehle‐Forbes, S., & Partin, M. R. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0357-x · Cited by 9 · see citing works
““Re-test” effects occur when groups repeatedly responding to the same scale report inexplicable net improvements despite no interventions being offered [31].”
BackgroundOperationalizing undifferentiated affect: Validity and utility in clinical samples
Lane, S. P., & Trull, T. J. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.690030 · Cited by 8 · see citing works
The Self-Contaminating Nature of Repeated Reports of Negative Emotions
Johar, O., & Sackett, A. M. (2018) · Basic and Applied Social Psychology · doi:10.1080/01973533.2018.1496336 · Cited by 6 · see citing works
“Thus, the field has a surprisingly limited understanding of the ways in which measurements can affect the phenomenon being studied (but see Knowles et al., 1996; Sharpe & Gilbert, 1998; Shrout et al., 2018).”
BackgroundAnxiety in Japanese Women After Elective Abortion
Kishida, Y. (2001) · Journal of Obstetric, Gynecologic & Neonatal Nursing · doi:10.1111/j.1552-6909.2001.tb01568.x · Cited by 6 · see citing works
Arslan, R. C., Reitz, A. K., Driebe, J. C., Gerlach, T. M., & Penke, L. (2019) · doi:10.31234/osf.io/va8bx · Cited by 7 · see citing works
Measuring ageism: Psychometric analysis of the Portuguese short form of the Fraboni Scale (FSA-SF)
Neto, J., & Neto, F. F. M. (2024) · Measurement Instruments for the Social Sciences · doi:10.5964/miss.11993 · Cited by 5 · see citing works
“Additionally, given its brevity, the FSA-SF may be less susceptible to “measurement-induced improvement in anxiety” (Knowles et al., 1996).”
BackgroundThe effect of serial day on the measurement of positivity and emotional complexity in diary studies
Ganzach, Y., & Bulmash, B. (2021) · European Journal of Social Psychology · doi:10.1002/ejsp.2809 · Cited by 5 · see citing works
“Knowles et al. (1996) found measurement-induced decrease in anxiety tests, and Merrilees et al. (2008) found that although self-reports indicated a temporal decrease in the perceptions of marital quality during a diary study, there were no apparent effects of time on couples’ emotions regarding…”
BackgroundA machine learning approach to identifying objective biomarkers of anxiety and stressPreprint
Ramakrishnan, A., Pardes, A., Lynch, W., Molaro, C., & Platt, M. L. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/745315 · Cited by 6 · see citing works
Eisele, G. V., Vachon, H., Lafit, G., et al. (2021) · doi:10.31234/osf.io/k8me6 · Cited by 5 · see citing works
“The initial elevation bias refers to situations in which the fi rst data point is higher than subsequent measures, an observation that has repeatedly been made in non-ESM, longitudinal studies (e.g., Knowles et al., 1996; Patrick & Gilbert, 1998).”
ResultBlozis, S. A., & Villarreal, R. (2024) · Journal of Marketing Analytics · doi:10.1057/s41270-024-00347-6 · Cited by 4 · see citing works
“Self-report data are known, however, to exhibit a response pattern in which the first assessment tends to be more extreme than subsequent assessments (Knowles et al. 1996; Robins 1985; Sharpe and Gilbert 1998; Windle 1954).”
Variability of Color Choice in the Lüscher Color Test—Sex Differences
Kertzman, S., Spivak, B., Ben-Nahum, Z., Vainder, M., Weizman, A., & Mester, R. (2003) · Perceptual and Motor Skills · doi:10.2466/pms.2003.97.2.647 · Cited by 4 · see citing works
Hlynsson, J. I., Mechler, J., Lindqvist, K., Andersson, G., & Carlbring, P. (2026) · Internet Interventions · doi:10.1016/j.invent.2026.100960 · Cited by 6 · see citing works
“…would align with the meaning-change hypothesis of measurement-induced improvement, which suggests that repeated assessment allows participants to discern the underlying construct more clearly, thereby shifting their interpretation and subsequent endorsement of symptom items (Knowles et al., 1996).”
Evaluations of Web-Based Psychological Interventions Need to Avoid the Re-Test Artefact
Jorm, A. F. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670903107641 · Cited by 3 · see citing works
Spence, T. E., Blumenthal, T., & Brenes, G. A. (2012) · Psychology · doi:10.4236/psych.2012.311141 · Cited by 2 · see citing works
“…function of repeated assessment (Windle, 1954), possibly due to an increased familiarity with the test items, such that some participants respond in accordance with what they perceive to be a more socially acceptable level of negative affect upon reassessment (Goldberg, 1978; Knowles et al., 1996).”
BackgroundInfluentialBoucher, C. M., Schneider, S. J., Puente-López, E., Sirianni, C. D., Cutler, L., Császár, K., & Erdődi, L. A. (2026) · Psychological Injury and Law · doi:10.1007/s12207-026-09565-y · Cited by 1 · see citing works
“…symptoms on the GAD-7 and the V-8 Anxiety scale was weaker, likely due to the normative decline in self-reported anxiety during the second administration (Erdodi et al., 2020; Knowles et al., 1996) that was not captured by the single-administration of the criterion measure (GAD-7).”
When secrets come to mind: Preoccupation, suppression and engagement
Davis, C. G., Wright, G. P., & McMillan, C. (2023) · European Journal of Social Psychology · doi:10.1002/ejsp.3019 · Cited by 1 · see citing works
First-interview response patterns of intensive longitudinal psychological and health data
Blozis, S. A. (2024) · Journal of Health Psychology · doi:10.1177/13591053241235751 · Cited by 1 · see citing works
van Strien, T., Winkens, L. H. H., & Konttinen, H. M. (2019) · International Journal of Obesity and Nutritional Science · doi:10.18689/ijons-1000103 · Cited by 1 · see citing works
“better able to discern its meaning and to use that meaning to interpret that item” [9].”
BackgroundResultInfluentialVARIABILITY OF COLOR CHOICE IN THE LUSCHER COLOR TEST—SEX DIFFERENCES
Kertzman, S. (2003) · Perceptual and Motor Skills · doi:10.2466/pms.97.6.647-656
No Initial Elevation on Personality Self-Reports in an Online Convenience Sample
Anvari, F., Arslan, R. C., Efendić, E., et al. (2024) · Collabra Psychology · doi:10.1525/collabra.117096
von Gugelberg, H. M. (2026) · Journal of Intelligence · doi:10.3390/jintelligence14090206
“One interpretation emphasizes the process of meaning-making during test taking (Knowles et al., 1996).”
- Authors
- Knowles, E. S., Coker, M. C., Scott, R. A., Cook, D. A., & Neville, J. W.
- Affiliations
- University of Arkansas at Fayetteville (US)
- Venue
- Journal of Personality and Social Psychology
- Published
- 1996
- Volume
- 71
- Issue
- 2
- Pages
- 352-363
- ISSN
- 0022-3514 (ISSN-L)
- 1939-1315
- OpenAlex
- W4236625252
- Cited by
- 58
- References
- 0
- Citations by year
- 2026: 3 · 2024: 4 · 2023: 1 · 2022: 5 · 2021: 1 · 2020: 2 · 2019: 4 · 2018: 3 · 2017: 3 · 2016: 2 · 2015: 3 · 2014: 1 · 2013: 2 · 2012: 2
- FWCI
- 2.18
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Personality and Social Psychology (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- anxiety, repeated assessment, mean shift, self-report measures, measurement error
- MeSH terms
- Anxiety Disorders, Female, Humans, Male
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review