Reliability and Validity Analyses of a Newly Developed Test to Assess Learning Strategy Knowledge
Abstract
This study presents a newly developed test to assess students’ knowledge of learning strategies that they use when completing complex assignments at the upper secondary baccalaureate school (Gymnasium) level. The sample included N = 2,300 students at 23 baccalaureate schools in Switzerland and also a small sample of university students (N = 58). We tested hypotheses regarding cognitive, metacognitive, and motivational dimensions of learning. In addition, students’ self-reported grades in German were used as an achievement criterion. The analyses included estimation of Cronbach’s alpha and distribution of the test scores on the individual and class level. Furthermore, structural equation modeling was carried out. The findings support the reliability and validity of the new test. We found significant differences in terms of gender and school attendance. Learning strategy knowledge showed a positive relationship with student achievement, students’ learning motivation, and students’self-reported use of habitual learning strategies.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Previous scenario-based measures aiming to capture predominantly metacognitive knowledge have provided good reasons for investing effort in developing and using these tools.
“Previous scenario-based measures aiming to capture predominantly metacognitive knowledge have provided good reasons for investing effort in developing and using these tools (e.g., Händel et al. 2014;Maag Merki et al. 2013;Neuenhaus et al. 2011).”
From Transfer of metacognitive skills in self-regulated learning: an experimental training study (2020) · cites this paper as Maag Merki et al. 2013
Cites
Intrinsic Motivation and Self-Determination in Human Behavior
Deci, E. L., & Ryan, R. M. (1985) · doi:10.1007/978-1-4899-2271-7 · Cited by 26,772 · see citing works
Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry
Flavell, J. H. (1979) · American Psychologist · doi:10.1037/0003-066x.34.10.906 · Cited by 11,282 · cited 1× · see citing works
“According to Artelt, Beinicke, Schlagmüller, and Schneider (2009) and with reference to Flavell (1979), strategy knowledge is a component of declarative metamemory: “In this understanding, learning strategy knowledge encompasses both knowledge about the demands involved in a task, and knowledge…”
BackgroundSchermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003) · Department of Psychology - University of Koblenz-Landau · doi:10.23668/psycharchives.12784 · Cited by 8,975 · see citing works
(2000) · Elsevier eBooks · doi:10.1016/b978-0-12-109890-2.x5027-6 · Cited by 4,439 · see citing works
Zimmerman, B. J. (2008) · American Educational Research Journal · doi:10.3102/0002831207312909 · Cited by 3,735 · see citing works
Studying as Self-Regulated Learning
(1998) · Metacognition in Educational Theory and Practice · doi:10.4324/9781410602350-19 · Cited by 1,589 · see citing works
Knowing when, where, and how to remember ; A problem of metacognition
Brown, A. L. (1978) · Medical Entomology and Zoology · Cited by 1,469 · see citing works
Self-regulated learning : from teaching to self-reflective practice
Schunk, D. H., & Zimmerman, B. J. (1998) · Cited by 1,426 · see citing works
Measuring Self-Regulated Learning
Winne, P. H., & Perry, N. E. (2000) · Handbook of Self-Regulation · doi:10.1016/b978-012109890-2/50045-7 · Cited by 1,383 · see citing works
Self-regulated learning: where we are today
Boekaerts, M. (1999) · International Journal of Educational Research · doi:10.1016/s0883-0355(99)00014-2 · Cited by 1,358 · see citing works
Paris, S. G., Lipson, M. Y., & Wixson, K. K. (1983) · Contemporary Educational Psychology · doi:10.1016/0361-476x(83)90018-8 · Cited by 1,349 · see citing works
Becoming a self-regulated learner: Which are the key subprocesses?
Zimmerman, B. J. (1986) · Contemporary Educational Psychology · doi:10.1016/0361-476x(86)90027-5 · Cited by 1,247 · see citing works
Theories of Self-Regulated Learning and Academic Achievement: An Overview and Analysis
Zimmerman, B. J. (2013) · doi:10.4324/9781410601032-5 · Cited by 1,139 · see citing works
Heckhausen, H. (1989) · Springer-Lehrbuch · doi:10.1007/978-3-662-08870-8 · Cited by 792 · see citing works
Kuhn, D. (2000) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00088 · Cited by 718 · see citing works
Schmitz, B., & Wiese, B. S. (2006) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2005.02.002 · Cited by 496 · see citing works
Improving Measurements of Self-Regulated Learning
Winne, P. H. (2010) · Educational Psychologist · doi:10.1080/00461520.2010.517150 · Cited by 420 · see citing works
Metacognition, Self-Regulation, and Self-Regulated Learning: Research Recommendations
Schunk, D. H. (2008) · Educational Psychology Review · doi:10.1007/s10648-008-9086-3 · Cited by 416 · see citing works
Cognitive strategies: Good strategy users coordinate metacognition and knowledge
Pressley, M. G., Borkowski, J. G., & Schneider, W. (1987) · Online Publication Service of Würzburg University (Würzburg University) · Cited by 391 · see citing works
Good information processing: What it is and how education can promote it
Pressley, M. G., Borkwski, J. G., & Schneider, W. (1989) · International Journal of Educational Research · doi:10.1016/0883-0355(89)90069-4 · Cited by 325 · see citing works
Berger, J., & Karabenick, S. A. (2010) · Learning and Instruction · doi:10.1016/j.learninstruc.2010.06.002 · Cited by 269 · see citing works
Structural Equation Modeling for Social and Personality Psychology
Hoyle, R. H. (2011) · SAGE Publications Ltd eBooks · doi:10.4135/9781446287965 · Cited by 246 · see citing works
(2005) · Cited by 219 · see citing works
Relations between metastrategic knowledge and strategic performance
Kuhn, D., & Pearsall, S. (1998) · Cognitive Development · doi:10.1016/s0885-2014(98)90040-5 · Cited by 136 · see citing works
Fifth graders metacognitive knowledge: general or domain-specific?
Neuenhaus, N., Artelt, C., Lingel, K., & Schneider, W. (2011) · European Journal of Psychology of Education · doi:10.1007/s10212-010-0040-7 · Cited by 85 · see citing works
Learners for life : student approaches to learning
Artelt, C., Baumert, J., McElvany, N., & Peschar, J. L. (2003) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 82 · see citing works
Erfassung selbstregulierten Lernens mit Selbstberichtsverfahren
Spörer, N., & Brunstein, J. C. (2006) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652.20.3.147 · Cited by 81 · see citing works
Self-Monitoring zur Unterstützung des Transfers einer Schulung in Selbstregulation für Studierende
Schmitz, B. (2001) · Zeitschrift für Pädagogische Psychologie · doi:10.1024//1010-0652.15.34.181 · Cited by 75 · see citing works
Diagnose von Strategiewissen beim Textverstehen
Artelt, C., Beinicke, A., Schlagmüller, M., & Schneider, W. (2009) · Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie · doi:10.1026/0049-8637.41.2.96 · Cited by 51 · see citing works
Artelt, C., Neuenhaus, N., Lingel, K., & Schneider, W. (2012) · Psychologische Rundschau · doi:10.1026/0033-3042/a000106 · Cited by 32 · see citing works
Schlagmüller, M., Visé, M., & Schneider, W. (2001) · Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie · doi:10.1026//0049-8637.33.2.91 · Cited by 23 · see citing works
Flagged first, then by citations
1 of the 32 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Sticca, F., Goetz, T., Bieg, M., Hall, N. C., Eberle, F., & Haag, L. (2017) · PLoS ONE · doi:10.1371/journal.pone.0187367 · Cited by 141 · see citing works
Karlen, Y., Hertel, S., & Hirt, C. N. (2020) · Frontiers in Education · doi:10.3389/feduc.2020.00159 · Cited by 149 · see citing works
Self-citationTransfer of metacognitive skills in self-regulated learning: an experimental training study
Schuster, C., Stebner, F., Leutner, D., & Wirth, J. (2020) · Metacognition and Learning · doi:10.1007/s11409-020-09237-5 · Cited by 105 · see citing works
Assessing metacognitive knowledge: development and evaluation of a test instrument
Händel, M., Artelt, C., & Weinert, S. (2013) · Pedocs (German Institute for International Educational Research) · doi:10.25656/01:8429 · Cited by 91 · see citing works
Interrelations between motivational regulation, procrastination and college dropout intentions
Bäulke, L., Eckerlein, N., & Dresel, M. (2018) · Unterrichtswissenschaft · doi:10.1007/s42010-018-0029-5 · Cited by 90 · see citing works
Karlen, Y. (2016) · The Journal of Educational Research · doi:10.1080/00220671.2014.942895 · Cited by 96 · see citing works
Self-citationQin, L. T., & Zhang, L. J. (2019) · Journal of Writing Research · doi:10.17239/jowr-2019.11.02.06 · Cited by 70 · see citing works
Bäulke, L., Daumiller, M. H., & Dresel, M. (2021) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2021.101951 · Cited by 52 · see citing works
Dörrenbächer‐Ulrich, L., Weißenfels, M., Russer, L., & Perels, F. (2021) · Instructional Science · doi:10.1007/s11251-020-09533-2 · Cited by 57 · see citing works
Karlen, Y., Hirt, C. N., Liska, A., & Stebner, F. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.661142 · Cited by 51 · see citing works
Self-citationKarlen, Y., & Compagnoni, M. (2016) · Psychology Learning & Teaching · doi:10.1177/1475725716682887 · Cited by 57 · see citing works
Self-citationKarlen, Y. (2017) · Journal of Writing Research · doi:10.17239/jowr-2017.09.01.03 · Cited by 54 · see citing works
Self-citationSelbstregulation und selbstreguliertes Lernen
Perels, F., Dörrenbächer‐Ulrich, L., Landmann, M., Otto, B., Schnick-Vollmer, K., & Schmitz, B. (2020) · Springer eBooks · doi:10.1007/978-3-662-61403-7_3 · Cited by 42 · see citing works
Selbstregulation und selbstreguliertes Lernen
Landmann, M., Perels, F., Otto, B., Schnick-Vollmer, K., & Schmitz, B. (2014) · Springer-Lehrbuch · doi:10.1007/978-3-642-41291-2_3 · Cited by 40 · see citing works
Khiat, H., & Vogel, S. (2022) · Journal of University Teaching and Learning Practice · doi:10.53761/1.19.2.4 · Cited by 34 · see citing works
Steuer, G., Engelschalk, T., Eckerlein, N., & Dresel, M. (2019) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652/a000237 · Cited by 33 · see citing works
The effect of individual differences in the development of metacognitive strategy knowledge
Karlen, Y., Merki, K. M., & Ramseier, E. (2014) · Instructional Science · doi:10.1007/s11251-014-9314-9 · Cited by 34 · see citing works
Self-citationKarlen, Y., Bäuerlein, K., & Brunner, S. N. (2023) · Social Psychology of Education · doi:10.1007/s11218-023-09845-4 · Cited by 30 · see citing works
Self-citationAssessment of metacognitive knowledge in students with special educational needs
Händel, M., Lockl, K., Heydrich, J., Weinert, S., & Artelt, C. (2014) · Metacognition and Learning · doi:10.1007/s11409-014-9119-x · Cited by 20 · see citing works
Dörrenbächer‐Ulrich, L., Sparfeldt, J. R., & Perels, F. (2024) · Metacognition and Learning · doi:10.1007/s11409-024-09379-w · Cited by 20 · see citing works
Teachers matter: linking teachers and students’ self-regulated learning
Karlen, Y., Hertel, S., Grob, U., Jud, J., & Hirt, C. N. (2024) · Research Papers in Education · doi:10.1080/02671522.2024.2394059 · Cited by 24 · see citing works
Self-citationGrüneisen, L., Dörrenbächer‐Ulrich, L., & Perels, F. (2023) · Acta Psychologica · doi:10.1016/j.actpsy.2023.104053 · Cited by 16 · see citing works
Karlen, Y. (2015) · Zeitschrift für Bildungsforschung · doi:10.1007/s35834-015-0123-2 · Cited by 11 · see citing works
Self-citationRuhl, J., Perels, F., & Dörrenbächer-Ulrich, L. (2025) · Learning and Individual Differences · doi:10.1016/j.lindif.2025.102760 · Cited by 13 · see citing works
Metacognitive Judgment Skills and the Metacognitive Component of Self-Regulated Learning
Dörrenbächer‐Ulrich, L., & Perels, F. (2023) · Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie · doi:10.1026/0049-8637/a000274 · Cited by 10 · see citing works
Rosenthal, A., Hirt, C. N., Eberli, T. D., Jud, J., & Karlen, Y. (2023) · Unterrichtswissenschaft · doi:10.1007/s42010-023-00189-8 · Cited by 13 · see citing works
Self-citationBrunner, S. N., Bäuerlein, K., Conti, M., & Karlen, Y. (2025) · Learning and Individual Differences · doi:10.1016/j.lindif.2025.102656 · Cited by 14 · see citing works
Self-citationAssessing knowledge about self-regulated learning: validation of a measurement tool for preschoolers
Grüneisen, L., Dörrenbächer‐Ulrich, L., Kapsali, E., & Perels, F. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1332170 · Cited by 9 · see citing works
Lernstrategiewissen im Bereich Englisch
Neuenhaus, N., Artelt, C., & Schneider, W. (2016) · Diagnostica · doi:10.1026/0012-1924/a000171 · Cited by 8 · see citing works
Self-regulation of resources in higher education
Trentepohl, S., Waldeyer, J., Fleischer, J., Roelle, J., Leutner, D., & Wirth, J. (2023) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652/a000374 · Cited by 7 · see citing works
Sind Gymnasiastinnen und Gymnasiasten mit mehr Grit erfolgreicher?
Karlen, Y., Merki, K. M., Hirt, C. N., & Suter, F. (2018) · Unterrichtswissenschaft · doi:10.1007/s42010-018-0030-z · Cited by 7 · see citing works
Self-citationBeyond counting the correct responses: Metacognitive monitoring and score estimations in mathematics
Başokçu, T. O., & Güzel, M. A. (2022) · Psychology in the Schools · doi:10.1002/pits.22665 · Cited by 6 · see citing works
Adolescent Metacognitive Knowledge during the Quran Memorization Process
Alaydrus, R. M. (2019) · Journal of Islamic Studies and Culture · doi:10.15640/jisc.v7n2a3 · Cited by 5 · see citing works
Başokçu, T. O., & Güzel, M. A. (2020) · TED EĞİTİM VE BİLİM · doi:10.15390/eb.2020.7991 · Cited by 2 · see citing works
Grobe, S. E., Könen, T., Rocker, C., Grüneisen, L., Dörrenbächer-Ulrich, L., Perels, F., & Karbach, J. (2025) · Cognitive Development · doi:10.1016/j.cogdev.2025.101644 · Cited by 1 · see citing works
Profiles of adolescents' self-regulated learning: Links to achievement and sociodemographic factors
Karlen, Y., & van Loon, M. H. (2026) · Learning and Individual Differences · doi:10.1016/j.lindif.2026.102892 · Cited by 1 · see citing works
Self-citationRocker, C., Grüneisen, L., Grobe, S. E., Dörrenbächer‐Ulrich, L., Karbach, J., & Perels, F. (2026) · Learning and Individual Differences · doi:10.1016/j.lindif.2026.102946 · Cited by 2 · see citing works
Bergen, A., Dörrenbächer‐Ulrich, L., & Karlen, Y. (2026) · Metacognition and Learning · doi:10.1007/s11409-026-09489-7 · Cited by 1 · see citing works
Self-citationJahrbuch der berufs- und wirtschaftspädagogischen Forschung 2016
Seifried, J., Seeber, S., & Ziegler, B. (2016) · Verlag Barbara Budrich eBooks · doi:10.3224/84740588 · Cited by 1 · see citing works
Jahrbuch der berufs- und wirtschaftspädagogischen Forschung 2016
(2016) · Verlag Barbara Budrich eBooks · doi:10.2307/j.ctvbkjztw
Bhrahmbhatt, C. (2020) · IAAR Journal of Education Peer-Reviewed Journal · doi:10.58213/education.v2i2.19
Goppert, S. (2023) · Schriften aus der Fakultät Humanwissenschaften der Otto-Friedrich-Universität Bamberg · doi:10.20378/irb-90487
- Authors
- Maag Merki, K., Ramseier, E., & Karlen, Y.
- Affiliations
- Pädagogische Hochschule Bern (CH)
- University of Zurich (CH)
- ORCID
- Karlen, Yves
- Venue
- Journal of Cognitive Education and Psychology
- Publisher
- Springer Publishing Company
- Published
- 2013
- Volume
- 12
- Issue
- 3
- Pages
- 391-408
- ISSN
- 1810-7621 (ISSN-L)
- 1945-8959
- OpenAlex
- W2319245719
- Cited by
- 43
- References
- 32
- Citations by year
- 2026: 3 · 2025: 3 · 2024: 3 · 2023: 6 · 2022: 2 · 2021: 3 · 2020: 5 · 2019: 3 · 2018: 2 · 2017: 2 · 2016: 6 · 2015: 1 · 2014: 3 · 2013: 1
- FWCI
- 7.44
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Cognitive Education and Psychology (publishedVersion)
- Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Education, Achievement, and Giftedness
- Keywords
- learning strategies, test development, test reliability, test validity, metacognition, student motivation, academic performance, upper secondary school, German language achievement, gender differences, school attendance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review