Cited by 50Digital literacy in educationProblem Solving Skills DevelopmentEducational Technology and Assessment

The computer-based assessment of complex problem solving and how it is influenced by students’ information and communication technology literacy

Open access
Greiff, Samuel, Kretzschmar, André, Müller, Jonas C., Spinath, Birgit, Martin, Romain·2014·Journal of Educational Psychology

Abstract

The 21st-century work environment places strong emphasis on nonroutine transversal skills.In an educational context, complex problem solving (CPS) is generally considered an important transversal skill that includes knowledge acquisition and its application in new and interactive situations.The dynamic and interactive nature of CPS requires a computer-based administration of CPS tests such that the assessment of CPS might be partially confounded with information and communication technology (ICT) literacy.To establish CPS as a distinct construct that involves complex cognitive processes not covered by other general cognitive abilities and not related to ICT literacy, it is necessary to investigate the influence of ICT literacy on CPS and on the power of CPS to predict external educational criteria.We did so in 3 different samples of either high school or university students using a variety of instruments to measure ICT literacy and general cognitive ability.Convergent results based on structural equation modeling and confirmatory factor analyses across the studies showed that ICT literacy was weakly or moderately related to CPS, and these associations were similar to those between ICT and other general cognitive abilities.Furthermore, the power of CPS to predict external educational criteria over and above general cognitive ability remained even if the influence of ICT literacy on CPS was controlled for.We conclude that CPS is a distinct construct that captures complex cognitive processes not generally found in other assessments of general cognitive ability or of ICT literacy.

Integrity signals

Registry

Crossref · 10.1037/a0035426

Cites

56 of 56 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Greiff, S., Kretzschmar, A., Müller, J. C., Spinath, B., & Martin, R.
Affiliations
  • University of Luxembourg (LU)
  • Heidelberg University (DE)
Venue
Journal of Educational Psychology
Published
2014-08
Volume
106
Issue
3
Pages
666-680
ISSN
  • 0022-0663 (ISSN-L)
  • 1939-2176
OpenAlex
W2083317718
Cited by
49
References
56
Citations by year
2025: 3 · 2024: 2 · 2023: 4 · 2022: 5 · 2021: 6 · 2020: 2 · 2019: 4 · 2018: 5 · 2017: 5 · 2016: 6 · 2015: 3 · 2014: 4
FWCI
16.64
Type
journal article
Language
en
Open access
Licence
other-oa
Locations
  • Journal of Educational Psychology (publishedVersion)
  • Open Repository and Bibliography (University of Luxembourg) (submittedVersion, other-oa)
  • Zurich Open Repository and Archive (University of Zurich) (submittedVersion)
Funders
  • Luxembourgish Research Foundation (FNR ATTRACT ASSKI21)
  • European Union (290683)
  • German Research Foundation (Fu 173-14/1)
  • German Federal Ministry of Education and Research (LSA004)
Topics
  • Physical Sciences › Computer Science › Information Systems › Digital literacy in education
  • Health Sciences › Health Professions › Speech and Hearing › Problem Solving Skills Development
  • Physical Sciences › Computer Science › Information Systems › Educational Technology and Assessment
Keywords
computer-based testing, complex problem solving, ICT literacy, student literacy, problem-solving assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review