Measuring achievement goal motivation, mindsets and cognitive load: validation of three instruments’ scores
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Objective: Measurement of motivation and cognitive load has potential value in health professions education. Our objective was to evaluate the validity of scores from Dweck's Implicit Theories of Intelligence Scale ( ITIS ), Elliot's Achievement Goal Questionnaire‐Revised ( AGQ ‐R) and Leppink's cognitive load index ( CLI ). Methods: This was a validity study evaluating internal structure using reliability and factor analysis, and relationships with other variables using the multitrait‐multimethod matrix. Two hundred and thirty‐two secondary school students participated in a medical simulation‐based training activity at an academic medical center. Pre‐activity ITIS (implicit theory [mindset] domains: incremental, entity) and AGQ ‐R (achievement goal domains: mastery‐approach, mastery‐avoidance, performance‐approach, performance‐avoidance), post‐activity CLI (cognitive load domains: intrinsic, extrinsic, germane) and task persistence (self‐directed repetitions on a laparoscopic surgery task) were measured. Results: Internal consistency reliability (Cronbach's alpha) was > 0.70 for all domain scores except AGQ ‐R performance‐avoidance (alpha 0.68) and CLI extrinsic load (alpha 0.64). Confirmatory factor analysis of ITIS and CLI scores demonstrated acceptable model fit. Confirmatory factor analysis of AGQ ‐R scores demonstrated borderline fit, and exploratory factor analysis suggested a three‐domain model for achievement goals (mastery‐approach, performance and avoidance). Correlations among scores from conceptually‐related domains generally aligned with expectations, as follows: ITIS incremental and entity, r = −0.52; AGQ ‐R mastery‐avoidance and performance‐avoidance, r = 0.71; mastery‐approach and performance‐approach, r = 0.55; performance‐approach and performance‐avoidance, r = 0.43; mastery‐approach and mastery‐avoidance, r = 0.36; CLI germane and extrinsic, r = −0.35; ITIS incremental and AGQ ‐R mastery‐approach, r = 0.34; ITIS incremental and CLI germane, r = 0.44; AGQ ‐R mastery‐approach and CLI germane, r = 0.48 (all p < 0.001). We found no correlation between the number of task repetitions (i.e. persistence) and mastery‐approach scores, r = −0.01. Conclusions: ITIS and CLI scores had appropriate internal structures and relationships with other variables. AGQ ‐R scores fit a three‐factor (not four‐factor) model that collapsed avoidance into one domain, although relationships of other variables with the original four domain scores generally aligned with expectations. Mastery goals are positively correlated with germane cognitive load.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
A social-cognitive approach to motivation and personality.
Dweck, C. S., & Leggett, E. L. (1988) · Psychological Review · doi:10.1037/0033-295x.95.2.256 · Cited by 9,745
A 2 × 2 achievement goal framework.
Elliot, A. J., & McGregor, H. A. (2001) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.80.3.501 · Cited by 3,953
Blackwell, L. S., Trzesniewski, K. H., & Dweck, C. S. (2007) · Child Development · doi:10.1111/j.1467-8624.2007.00995.x · Cited by 3,784
Approach and avoidance motivation and achievement goals
Elliot, A. J. (1999) · Educational Psychologist · doi:10.1207/s15326985ep3403_3 · Cited by 3,103
Cognitive Load Theory and Complex Learning: Recent Developments and Future Directions
van Merriënboer, J. J. G., & Sweller, J. (2005) · Educational Psychology Review · doi:10.1007/s10648-005-3951-0 · Cited by 2,206
Paas, F. G. W. C. (1992) · Journal of Educational Psychology · doi:10.1037/0022-0663.84.4.429 · Cited by 2,150
Validating the interpretations and uses of test scores
Kane, M. T. (2013) · Journal of Educational Measurement · doi:10.1111/jedm.12000 · Cited by 2,110
Preston, C. C., & Colman, A. M. (2000) · Acta Psychologica · doi:10.1016/s0001-6918(99)00050-5 · Cited by 2,106
Current Concepts in Validity and Reliability for Psychometric Instruments: Theory and Application
Cook, D. A., & Beckman, T. J. (2006) · The American Journal of Medicine · doi:10.1016/j.amjmed.2005.10.036 · Cited by 1,745
Self-citationCognitive load theory in health professional education: design principles and strategies
Van Merriënboer, J. J. G., & Sweller, J. (2010) · Medical Education · doi:10.1111/j.1365-2923.2009.03498.x · Cited by 1,511
Mind-sets matter: A meta-analytic review of implicit theories and self-regulation.
Burnette, J. L., O'Boyle, E. H., VanEpps, E. M., Pollack, J. M., & Finkel, E. J. (2013) · Psychological Bulletin · doi:10.1037/a0029531 · Cited by 1,367
Social-Psychological Interventions in Education: They’re Not Magic
Yeager, D. S., & Walton, G. M. (2011) · Review of Educational Research · doi:10.3102/0034654311405999 · Cited by 1,345
On the measurement of achievement goals: Critique, illustration, and application.
Elliot, A. J., & Murayama, K. (2008) · Journal of Educational Psychology · doi:10.1037/0022-0663.100.3.613 · Cited by 1,281
Development of an instrument for measuring different types of cognitive load
Leppink, J., Paas, F., Van der Vleuten, C. P. M., Van Gog, T., & Van Merriënboer, J. J. G. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0334-1 · Cited by 1,066
Efficiency in learning: Evidence-based guidelines to manage cognitive load
Clark, R. C., Nguyen, F., Sweller, J., & Baddeley, M. (2006) · Performance Improvement · doi:10.1002/pfi.4930450920 · Cited by 820
ten Cate, O. T. J., Kusurkar, R. A., & Williams, G. C. (2011) · Medical Teacher · doi:10.3109/0142159x.2011.595435 · Cited by 697
Motivation Interventions in Education: A Meta-Analytic Review
Lazowski, R. A., & Hulleman, C. S. (2016) · Review of Educational Research · doi:10.3102/0034654315617832 · Cited by 607
Effects of pairs of problems and examples on task performance and different types of cognitive load
Leppink, J., Paas, F., van Gog, T., van der Vleuten, C. P. M., & van Merriënboer, J. J. G. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2013.12.001 · Cited by 520
Performance Effects of Motivational State: A Meta-Analysis
Utman, C. H. (1997) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0102_4 · Cited by 437
Paas, F., Tuovinen, J. E., van Merriënboer, J. J. G., & Aubteen Darabi, A. (2005) · Educational Technology Research and Development · doi:10.1007/bf02504795 · Cited by 401
Believing is seeing: how people's beliefs influence goals, emotions and behaviour
Teunissen, P. W., & Bok, H. G. J. (2013) · Medical Education · doi:10.1111/medu.12228 · Cited by 99
Instructional benefits of spoken words: A review of cognitive load factors
Kalyuga, S. (2012) · Educational Research Review · doi:10.1016/j.edurev.2011.12.002 · Cited by 93
Cited by
Cognitive load theory and its relationships with motivation: A self-determination theory perspective
Evans, P., Vansteenkiste, M., Parker, P., Kingsford-Smith, A., & Zhou, S. (2024) · Educational Psychology Review · doi:10.1007/s10648-023-09841-2 · Cited by 200
Krieglstein, F., Beege, M., Rey, G. D., Ginns, P., Krell, M., & Schneider, S. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09683-4 · Cited by 118
Scherer, R., & Campos, D. G. (2022) · Educational Research Review · doi:10.1016/j.edurev.2022.100479 · Cited by 63
Knowledge or Abilities? How Undergraduates Define Intelligence
Limeri, L. B., Choe, J., Harper, H. G., Martin, H. R., Benton, A., & Dolan, E. L. (2020) · CBE—Life Sciences Education · doi:10.1187/cbe.19-09-0169 · Cited by 59
Metadata
- Authors
- Cook, D. A., Castillo, R. M., Gas, B., & Artino, A. R.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 2017-09-13
- Volume
- 51
- Issue
- 10
- Pages
- 1061-1074
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2754210798
- Cited by
- 68
- References
- 23
- FWCI
- 3.77
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.