The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Cognitive Processing of Self-Report Items in Educational Research: Do They Think What We Mean?
Abstract
Techniques emerging from the considerable research on cognitive aspects of survey methodology include various forms of probing and cognitive interviewing. These techniques are used to examine whether respondents' interpretations of self-report items are consistent with researchers' assumptions and intended meanings given the constructs the items are designed to measure. However, although informal procedures are common, such developments have not been systematically applied in educational research. We describe how information derived from the systematic application of cognitive pretesting can contribute to determining the validity—designated cognitive validity—of self-report items. Examples are presented from prominent motivation-related instruments that assess real-world instructional practices, mastery classroom goal structure, and student self-efficacy. The implications and pragmatics of adopting this approach are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Self-efficacy: The exercise of control
Bandura, A., Freeman, W. H., & Lightsey, R. (1999) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.13.2.158 · Cited by 46,835
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Motivational and self-regulated learning components of classroom academic performance.
Pintrich, P. R., & De Groot, E. V. (1990) · Journal of Educational Psychology · doi:10.1037/0022-0663.82.1.33 · Cited by 8,332
Classrooms: Goals, structures, and student motivation.
Ames, C. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.3.261 · Cited by 6,468
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Self-reports: How the questions shape the answers.
Schwarz, N. (1999) · American Psychologist · doi:10.1037/0003-066x.54.2.93 · Cited by 2,846
Academic Self-Concept and Self-Efficacy: How Different Are They Really?
Bong, M., & Skaalvik, E. M. (2003) · Educational Psychology Review · doi:10.1023/a:1021302408382 · Cited by 1,994
Willis, G. (2005) · doi:10.4135/9781412983655 · Cited by 1,778
Measuring Self-Regulated Learning
Winne, P. H., & Perry, N. E. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50045-7 · Cited by 1,383 · cited 1×
“For example, these authors suggested that it is unlikely that learners tally and store the number of events but rather rely on heuristics (e.g., availability) when reporting the incidence of strategy use (Winne, Jamieson-Noel, & Muis, 2002; Winne & Perry, 2000).”
BackgroundRyan, A. M., & Patrick, H. (2001) · American Educational Research Journal · doi:10.3102/00028312038002437 · Cited by 1,315
Cited by
Pekrun, R., Goetz, T., Frenzel, A. C., Barchfeld, P., & Perry, R. P. (2011) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2010.10.002 · Cited by 2,248
The Math and Science Engagement Scales: Scale development, validation, and psychometric properties
Wang, M.-T., Fredricks, J. A., Ye, F., Hofkens, T. L., & Linn, J. S. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.01.008 · Cited by 592
A Review of Self-Report and Alternative Approaches in the Measurement of Student Motivation
Fulmer, S. M., & Frijters, J. C. (2009) · Educational Psychology Review · doi:10.1007/s10648-009-9107-x · Cited by 227
Wang, M.-T., Fredricks, J., Ye, F., Hofkens, T., & Linn, J. S. (2019) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000431 · Cited by 214
Self-report is indispensable to assess students’ learning
Pekrun, R. (2020) · Frontline Learning Research · doi:10.14786/flr.v8i3.637 · Cited by 160
Measuring strategy use with self-report instruments: theoretical and empirical considerations
Schellings, G., & Van Hout-Wolters, B. (2011) · Metacognition and Learning · doi:10.1007/s11409-011-9081-9 · Cited by 143
Greene, J. A., Hutchison, L. A., Costa, L.-J., & Crompton, H. (2012) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2012.02.002 · Cited by 74
Learning Strategies, Study Skills, and Self-Regulated Learning in Postsecondary Education
Winne, P. H. (2013) · Higher Education: Handbook of Theory and Research · doi:10.1007/978-94-007-5836-0_8 · Cited by 73
Zhang, H., Perry, A., & Lee, I. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00398-x · Cited by 75
Mlodzinski, E., Wardi, G., Viglione, C., Nemati, S., Crotty Alexander, L., & Malhotra, A. (2023) · JMIR Perioperative Medicine · doi:10.2196/41056 · Cited by 28
Metadata
- Authors
- KARABENICK, S. A., WOOLLEY, M. E., FRIEDEL, J. M., AMMON, B. V., BLAZEVSKI, J., BONNEY, C. R., GROOT, E. D., GILBERT, M. C., MUSU, L., KEMPLER, T. M., & KELLY, K. L.
- Venue
- Educational Psychologist
- Publisher
- Informa UK Limited
- Published
- 2007-07-27
- Volume
- 42
- Issue
- 3
- Pages
- 139-151
- ISSN
- 0046-1520 (ISSN-L)
- 1532-6985
- OpenAlex
- W2099535978
- Cited by
- 381
- References
- 11
- FWCI
- 30.48
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
