Quantifying media literacy: development, reliability, and validity of a new measure
Open accessThe DOI matches its Crossref record.
Abstract
Media literacy has the potential to alter outcomes in various fields, including education, communication, and public health. However, measurement of media literacy remains a critical challenge in advancing this field of inquiry. In this manuscript, we describe the development and testing of a pilot measure of media literacy. Items were formed based on a composite conceptual model and administered to college communications students (n = 34). Each of three media literacy subscales had good internal consistency reliability (α1 = 0.74, α2 = 0.79, α3 = 0.75). Principal components analysis revealed a five‐factor structure that corresponded closely with the underlying conceptual model. As was expected, the media literacy scale was significantly correlated with a composite critical thinking measure (r = 0.32, P = .03). This scale may be valuable for the measurement of media literacy and the assessment of media literacy interventions. La quantification de la compétence médiatique:le développement, la fiabilité et la validité d'une nouvelle mesure La mesure de la compétence médiatique demeure un défi décisif pour faire progresser ce champ d'étude. Dans cet article nous décrivons le développement et l'expérimentation d'une mesure nouvelle de la compétence médiatique. Des éléments ont été formés en se fondant sur un modèle conceptuel composite et ils ont été soumis à des étudiants de premier cycle de communication (n = 34). Chacune des sous‐échelles de compétence médiatique présentait une bonne fiabilité de par sa consistence interne (α1 = 0.74, α2 = 0.79, α3 = 0.75). L'analyse des principaux composants a fait apparaître une structure de facteur 5 qui correspondait étroitement au modèle conceptuel sous jacent. Comme on pouvait s'y attendre, l'échelle de compétence médiatique présentait une forte corrélation avec la mesure composite du raisonnement critique (r = 0.32, P = .03). Cette échelle peut se révéler utile pour la mesure de la compétence médiatique et l'évaluation des interventions portant sur cette compétence. Die Quantifizierung von Medienkompetenz: Entwicklung, Zuverlässigkeit und Gültigkeit einer neuen Maßeinheit Messung der Medienkompetenz ist eine kritische Herausforderung bei der Förderung dieses Bereichs der Untersuchung. In diesem Manuskript beschreiben wir die Entwicklung und Erprobung einer Pilot‐Maßnahme zur Medienkompetenz. Elemente wurden auf der Grundlage eines gemischt‐konzeptionellen Modells entworfen und an Kommunikationsstudenten (n = 34) ausgegeben. Jede der drei Medienkompetenz‐Sub‐Skalen hatte gute interne Kohärenz Zuverlässigkeit (α1 = 0,74, α2 = 0,79, α3 = 0,75). Die Komponentenanalyse wichtiger Komponenten ergab eine 5‐Faktor‐Struktur, die eng dem zugrunde liegenden konzeptionellen Modell entsprach. Wie erwartet, war der Medienkompetenz Maßstab signifikant korreliert mit einem Composite‐kritischen Denk‐Maß (r = 0.32, P = .03). Diese Skala kann wertvoll für das Messen von Medienkompetenz und die Bewertung von Medienkompetenz Interventionen sein. Cuantificar el alfabetismo mediático :el desarrollo, la fiabilidad y validez de una nueva medida La medición del alfabetismo mediático sigue siendo un reto critíco en el desarrollo de ese campo de investigación. En este artículo describimos el desarrollo y prueba de una medida pilota del alfabetismo mediático.Items han sido formados basandose en un modelo conceptual compuesto y han sido sometidos a estudiantes de primer ciclo de comunicaciones (n = 34). Cada una de las tres subescalas de alfabetismo mediático tenía una buena fiabilidad basada en su consistencia interna (α1 = 0.74, α2 = 0.79, α3 = 0.75). El análisis de los principales componentes reveló una estructura de factor 5 que correspondía muy de cerca al modelo conceptual subyacente.Como era de esperar la escala de alfabetismo mediático presentaba una fuerte correlación con la medida compuesta del pensamiento crítico (r = 0.32, P = .03).Esa escala puede revelarse útil para medir el alfabetismo mediático y evaluar las intervenciones relacionadas con ese alfabetismo.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Evaluating Media Literacy Education: Concepts, Theories and Future Directions
Martens, H. (2010) · Journal of Media Literacy Education · doi:10.23860/jmle-2-1-1 · Cited by 253
Developing a News Media Literacy Scale
Ashley, S., Maksl, A., & Craft, S. (2013) · Journalism & Mass Communication Educator · doi:10.1177/1077695812469802 · Cited by 227
Media/marketing influences on adolescent and young adult substance abuse
Jackson, K. M., Janssen, T., & Gabrielli, J. (2018) · Current Addiction Reports · doi:10.1007/s40429-018-0199-6 · Cited by 116
Kurz, M., Rosendahl, J., Rodeck, J., Muehleck, J., & Berger, U. (2022) · Journal of Prevention · doi:10.1007/s10935-021-00660-1 · Cited by 110
Metadata
- Authors
- Arke, E. T., & Primack, B. A.
- Venue
- Educational Media International
- Publisher
- Informa UK Limited
- Published
- 2009-03
- Volume
- 46
- Issue
- 1
- Pages
- 53-65
- ISSN
- 0952-3987 (ISSN-L)
- 1469-5790
- OpenAlex
- W2104387232
- Cited by
- 123
- References
- 0
- FWCI
- 60.24
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quantifying media literacy: development, reliability, and validity of a new measure. https://app.cochat.ai/papers/10.1080/09523980902780958
- The paper
- Arke, E. T., & Primack, B. A. (2009). Quantifying media literacy: development, reliability, and validity of a new measure. Educational Media International. https://doi.org/10.1080/09523980902780958
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.