Cited by 42Literacy, Media, and EducationLibrary Science and Information LiteracyEducation and Digital Technologies

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index; none of the 12 sources its claims cite is checked for support yet.

Media and information literacy: a measurement instrument for adolescents

Open access
Cuervo Sánchez, Sandra Liliana, Foronda Rojo, Ainize, Rodríguez Martínez, Ana, Medrano Samaniego, Concepción·2021·Educational Review

Abstract

Media and information literacy is the process of empowering people to seek, evaluate, use and create information effectively in order to achieve their personal, social, occupational and educational goals. This paper presents the dimensions and categories of an instrument (the MIL questionnaire) developed within the University of the Basque Country’s UNESCO Chair in Communication and Educational Values, which aims to analyse media and information literacy levels amongst adolescents. The instrument is based on four dimensions that encompass basic aspects of the field of educommunication. These dimensions are: (1) Media access and use; (2) Media language and critical comprehension; (3) Production and programming processes; and (4) Transforming one’s situation through communication. The aim of this piece of research was to test the reliability and validity of this instrument in a pilot study conducted with 167 adolescents aged between 13 and 15, from schools in Colombia, Ecuador and Spain. With the exception of the first dimension, the results indicate that the questionnaire has an acceptable reliability level and is an adequate instrument for evaluating media and information literacy among adolescents.

Overview

AI snapshot

Written from the paper’s full text.

TL;DR

This paper presents and pilot-tests a four-dimension Media and Information Literacy (MIL) questionnaire for adolescents, using 167 students aged 13–15 in Spain, Colombia, and Ecuador. It reports acceptable reliability and validity for parts of the instrument, but several dimensions and questions require revision or elimination.

Key findings

  • The pilot sample comprised 167 adolescents in year 3 of compulsory secondary education (13–15 years); 68.5% were 14 years old, 43.1% were boys, and 54.9% were girls.
  • Reliability varied by dimension: Dimension 1 (Media access and use) had Cronbach’s alpha .658 and was eliminated due to scores clustering near the maximum and normality problems; Dimension 2 (Media language and critical comprehension) had Cronbach’s alpha .130, indicating its questions measured independent competences and should be analysed separately.
  • Dimension 3 (Production and programming processes) could not have Cronbach’s alpha calculated because asymmetry and kurtosis deviated from normality; Q17 was eliminated, and only items on production phases were usable, while cultural function items should be eliminated.
  • Dimension 4 (Transforming one’s situation through communication) could assess all categories, but three questions were eliminated; Q19 subscales reached .515 and .452, and Q22’s “lucidity” dimension had alpha .655, while the “credulity” dimension was .298.

Methods

  • Quantitative exploratory pilot study using an online questionnaire administered anonymously in Spanish and adapted to Colombian, Ecuadorian, and Spanish contexts; content validity was reviewed by six experts (three in education, three in communication).
  • Participants were 167 adolescents aged 13–15 from public and private schools in Spain, Colombia, and Ecuador, selected through an intentional non-probabilistic method.
  • Data were analysed with SPSS version 20 using descriptive statistics, cross-tabulation in some cases, and Cronbach’s alpha for reliability.

Limitations

  • The paper states that the statistical results show this area requires further study and that item reliability needs improvement; Dimension 1 was eliminated due to normality problems, Dimension 2 questions should be explored separately, Dimension 3 cultural function items should be eliminated, and three Dimension 4 questions were eliminated due to unacceptable validity and reliability.
  • The paper also notes that Q20’s multiple-choice format contaminated score calculations with commitment-related elements, Q21 had limited sensitivity, Q22’s credulity dimension was low, and Q23’s global index had insufficient reliability so items were considered separately.
  • Evident from the text: the small pilot sample (167) and intentional non-probabilistic sampling from accessible schools limit generalisability, and Cronbach’s alpha could not be calculated for Dimensions 3 and 4 because the data deviated from normality.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1080/00131911.2019.1646708

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

0 of 12 cited sources checked · 0 supported · 0 flagged

Verify all 4 references — free account
  • Findingown data

    In the third dimension, Cronbach's alpha cannot be calculated because asymmetry and kurtosis deviate from normality.

    “Cronbach's alpha is not shown in this dimension, because as shown in tables 5, 6 and 7, the asymmetry and kurtosis indicate that it is not possible to calculate this statistic because they deviate from normality.”
    Quote in the paperNot a substantial claim
  • Findingown data

    Due to insufficient reliability levels in the global index, the items of question 23 were considered separately.

    “Due to insufficient reliability levels in the global index, the items of question 23 were considered separately.”
    Quote in the paperNot a substantial claim
  • Findingown data

    In the fourth dimension, Cronbach's alpha cannot be calculated because asymmetry and kurtosis deviate from normality.

    “In this dimension Cronbach's alpha is not shown, because as shown in tables 8, 9 and 14, the asymmetry and kurtosis indicate that it is not possible to calculate this statistic because they deviate from normality”
    Quote in the paperNot a substantial claim
  • Findingown data

    In the first dimension (Media access and use), Cronbach's alpha was .658.

    “A Cronbach's alpha of .658was obtained in the internal consistency analyses of the first dimension.”
    Quote in the paperSubstantial claim
  • Findingown data

    In the third dimension, the absence of internal consistency between the items of question 17 indicates that question 17 should be eliminated.

    “As shown in Table 7, the absence of internal consistency between the items of question 17 indicates that this question should be eliminated, since internal consistency analyses reveal unacceptable levels that cannot be resolved.”
    Quote in the paperSubstantial claim
  • It may state two separate claims as one. 21
  • The quote only partly states this claim. 1
  • Probably not a substantial claim. 9
  • It may state two separate claims as one.

    Findingown data

    In the fourth dimension, the internal consistency of question 19 was below the accepted minimum, but two subscales ('content' and 'programming and publicity') reached the required minimum level.

    “The internal consistency of question 19 was also found to be below the accepted minimum.However, two subscales were established, one called 'content', encompassing items 2, 4 and 5, and another called 'programming and publicity', encompassing items 1 and 3.As shown in Table 10, in this structure the coefficients of internal consistency reach the required minimum level.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingown data

    Question 21 has a good distribution model and discriminatory power, although its sensitivity is limited.

    “The question was found to have a good distribution model and discriminatory power, although apparently, its degree of sensitivity is limited.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one. The quote only partly states this claim.

    Findingown data

    In the fourth dimension, the distribution models of questions 3, 4 and 11 have an acceptable level of normality, and their asymmetry and kurtosis reflect a notable deviation from normality.

    “The distribution models of these questions have an acceptable level of normality and their asymmetry and kurtosis reflect a notable deviation from normality.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingown data

    The 'lucidity' subscale of question 22 has adequate distribution and discrimination coefficients.

    “Table 13 shows the basic statistical coefficients of the 'lucidity' subscale, which are adequate as regards both distribution and discrimination.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingown data

    In the fourth dimension, the internal consistency of question 18 was below the acceptable level, but its items had correct distribution models and high discrimination potential.

    “The internal consistency of question 18 was found to be below the acceptable level.However, in the basic descriptive statistics for each item the distribution models are correct and the potential for discrimination is high.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingown data

    In the first dimension, all scores were close to the maximum, generating normality problems due to high asymmetry and kurtosis.

    “All scores were fairly close to the maximum, thus generating normality problems in the distribution due to the presence of high asymmetry and kurtosis coefficients.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingown data

    In a pilot study with 167 adolescents aged 13-15 from schools in Colombia, Ecuador and Spain, the MIL questionnaire, with the exception of its first dimension, showed an acceptable reliability level and is an adequate instrument for evaluating media and information literacy among adolescents.

    “With the exception of the first dimension, the results indicate that the questionnaire has an acceptable reliability level and is an adequate instrument for evaluating media and information literacy among adolescents.”
    Quote in the paperSubstantial claim
  • It may state two separate claims as one.

    Findingown data

    In the second dimension, the distribution models were compatible with normal distribution, with asymmetry within the -1 and +1 range.

    “the results revealed distribution models compatible with normal distribution, with an asymmetry level within the -1 and +1 range.”
    Quote in the paperNot a substantial claim
  • It may state two separate claims as one.

    Findingown data

    The dimension labelled Media access and use was eliminated, mainly because the mean and maximum scores were very similar, generating normality problems.

    “Firstly, the dimension labelled Media access and use was eliminated, mainly because the mean and maximum scores were very similar, thus generating normality problems.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. It may state two separate claims as one.

    Premisenone given

    The MIL instrument is not an attitude questionnaire, but a test designed to measure recognition and mastery.

    “The instrument is not an attitude questionnaire, but rather a test designed to measure recognition and mastery.”
    Quote in the paperSubstantial claim
  • It may state two separate claims as one.

    Interpretationown data

    The statistical results reveal that the area of the questionnaire concerning skills and knowledge requires further study and that the reliability of the items needs to be improved.

    “Nevertheless, the statistical results reveal that this is an area of the questionnaire that requires further study, and that the reliability of the items needs to be improved.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisenone given

    Each dimension of the MIL questionnaire comprises a set of categories which serve as indicators.

    “Each dimension comprises a set of categories which serve as indicators, establishing theme-based ranges of basic knowledge.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Premisecitation

    Khlaisang and Koraneekij (2019) developed a standardized measurement instrument with students possessing a higher level of education.

    “As such we must highlight the work of Khlaisang and Koraneekij (2019), who have developed a standardized measurement instrument with students possessing a higher level of education.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Khlaisang and Koraneekij (2019) source
  • It may state two separate claims as one.

    Interpretationown data

    The results of the pilot study confirm the reliability and validity of the MIL instrument described at the beginning of the paper.

    “The results of the pilot study confirm the reliability and validity of the instrument described at the beginning of this paper.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: All schools in all contexts had similar socioeconomic characteristics.
    • Rests on an assumption: The reliability and validity results from the intentional sample of 167 adolescents can be generalized to adolescents in different cultural contexts.
  • It may state two separate claims as one.

    Interpretationown data

    In the second dimension, Cronbach's alpha was .130, indicating that the questions measured independent competences and should be considered separately in subsequent analyses.

    “the coefficients obtained (Cronbach's Alpha: .130)reveal that the questions measured independent competences and should therefore be considered separately in subsequent analyses.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. It may be too vague to check against evidence.

    Premisecitation

    There is a need to develop instruments which will enable teachers to help students adopt a critical attitude and approach to both information and the media.

    “Diverse studies have also demonstrated that alongside family, school and peers, the media act as agents for socialisation in relation to both values and ideologies, and have highlighted the need to develop instruments which will enable teachers to help students adopt a critical attitude and approach to both information and the media (Livingstone & Helsper, 2010).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Livingstone & Helsper, 2010

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim.

    Interpretationreasoning

    The instrument presented here summarises and groups together, through the question-based model, all the skills, knowledge and abilities adolescents should have in relation to media, information and their own capacity as users and cultural agents.

    “In this sense, the instrument presented here summarises and groups together, through the question-based model, all the skills, knowledge and abilities adolescents should have in relation to the media, information and their own capacity as users and cultural agents.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. The paper’s conclusions may not depend on it.

    Interpretationreasoning

    Question 20's multiple-choice format contaminates score calculations with elements unrelated to the measurement aim, such as participants' commitment to completing the questionnaire.

    “Question 20 was posed in a multiple choice format, which means that score calculations are contaminated by other elements not related to the measurement aim, such as participants' degree of commitment to completing the questionnaire to the best of their ability.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.

    Premisenone given

    The MIL questionnaire consists of four dimensions: media access and use; media language and critical comprehension; production and programming processes; and transforming one's situation through communication.

    “The structure we propose consists of four large-scale dimensions which together aim to identify adolescents' ability level both in relation to the information they receive and generate, and as regards mediations.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim.

    Interpretationreasoning

    The MIL instrument enables an assessment of media and information literacy.

    “We believe that the instrument presented here may be of great use to the scientific community, since it enables an assessment of media and information literacy, a construct that, at present, lacks rigorous diagnosis and evaluation measures.”
    Quote in the paperSubstantial claim
  • It may state two separate claims as one.

    Premisecitation

    Prior assessment scales used in research have focused on digital competences, education specialists, or self-reporting of skills through Likert-type scales.

    “Since the assessment scales used in prior research have all focused on digital competences, education specialists or the self-reporting of skills through Likert-type scales (Chang et al., 2011;Eristi & Erdem, 2017;Lee, Chen, Li, & Lin, 2015;Literat, 2014), this instrument is an innovative one in the field of media and information literacy.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Chang et al., 2011

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Eristi & Erdem, 2017 source
    • cites Lee, Chen, Li, & Lin, 2015 source
  • It may state two separate claims as one.

    Premisecitation

    Adolescents tend to have excellent access to computers, the Internet, mobile telephones and multiple digital devices, and are proficient in their use.

    “These studies coincide in indicating that this segment of the population tends to have excellent access to computers, the Internet, mobile telephones and multiple digital devices, and is proficient in their use.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites Falbe et al., 2014 source
    • cites Somyürek & Coşkun, 2013 source
    • cites Willoughby, 2008 source
  • It may state two separate claims as one.

    Interpretationown data

    In the third dimension, only those items from the category referring to production phases can be used, whereas those belonging to the category assessing knowledge of the cultural function of the media should be eliminated; only the most technical aspects of this dimension can be assessed using the instrument.

    “In the third dimension, Production and programming processes, only those items from the category referring to production phases can be used, whereas those belonging to the category which assesses knowledge of the cultural function of the media should be eliminated.In other words, only the most technical aspects of this dimension can be assessed using the instrument proposed here.”
    Quote in the paperSubstantial claim
  • It may state two separate claims as one.

    Interpretationown data

    The instrument presented here has an acceptable level of reliability and validity, and can be partially used for assessing the media and information literacy of adolescents in different cultural contexts.

    “Thus, we can cautiously conclude that the instrument presented here has an acceptable level of reliability and validity, and can be partially used for assessing the media and information literacy of adolescents in different cultural contexts.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: All schools in all contexts had similar socioeconomic characteristics.
    • Rests on an assumption: The reliability and validity results from the intentional sample of 167 adolescents can be generalized to adolescents in different cultural contexts.
  • It may state two separate claims as one.

    Interpretationown data

    In the second dimension, the Cronbach's alpha results suggest that the different questions should be explored separately in subsequent analyses, even though each was found to have an adequate level of discrimination; it is possible to work with all the questions that make up this dimension.

    “In relation to the second dimension, Media language and critical comprehension, the Cronbach's alpha results obtained suggest that the different questions should be explored separately in subsequent analyses, even though each was found to have an adequate level of discrimination.In other words, it is possible to work with all the questions that make up this dimension.”
    Quote in the paperSubstantial claim
  • It may state two separate claims as one.

    Study design and conductnone given

    The instrument's content validity was verified by six experts (three in education and three in communication) and small modifications were made accordingly.

    “Prior to its application, the instrument was revised by six experts from the fields of communication and education.”
    • Also stated in: § 5. Procedure · plain
      “Regarding the content validity, it is necessary to indicate that the validity of the instrument was verified by six experts (three in education and three in communication) and some small modifications were made accordingly.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim. It may state two separate claims as one.

    Interpretationown data

    Questions referring to abilities, skills and knowledge in the Media access and use dimension require further work, as do those in the cultural function of the media category and certain aspects of communications skills and technological appropriation.

    “Nevertheless, questions referring to abilities, skills and knowledge in the Media access and use dimension require further work, as do those in the cultural function of the media category and certain aspects of communications skills and technological appropriation.”
    Quote in the paperSubstantial claim
27 of 27
  • The paper relies on this without support.

    Media and information literacy lacks rigorous diagnosis and evaluation measures.

    “a construct that, at present, lacks rigorous diagnosis and evaluation measures.”
  • The paper relies on this without support.

    All schools in all contexts had similar socioeconomic characteristics.

    “All schools in all contexts had similar socioeconomic characteristics.”
  • The paper relies on this without support.

    The reliability and validity results from the intentional sample of 167 adolescents can be generalized to adolescents in different cultural contexts.

    “can be partially used for assessing the media and information literacy of adolescents in different cultural contexts.”
3 of 3

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Reliability exception overlooks the second dimension

    Major

    The abstract says the questionnaire has acceptable reliability apart from its first dimension. The results report a Cronbach's alpha of .130 for the second dimension and say its questions should be considered separately, contradicting that summary.

  • The same distributions are called normal and notably non-normal

    Minor

    The results describe the distributions of questions 3, 4 and 11 as having acceptable normality, then say their asymmetry and kurtosis show a notable deviation from normality.

  • Lower-reliability subscale is said to meet the minimum

    Minor

    The paper says question 19's overall internal consistency is below the accepted minimum, but then says both subscales reach that minimum. Table 10 gives the overall coefficient as .492 and one subscale's as the lower value .452.

3 of 3

Citations

Cites

Flagged first, then by citations

Research works printed but not linked: 6

  1. Chang C. S., 2011, TOJET: the Turkish Online Journal of Educational Technology, 10
  2. Ferrés J., 2011, Competencia mediática Investigación Sobre el Grado de Competencia de la Ciudadanía en España
  3. Harshman J., 2017, Journal of Social Studies Education Research, 8, 69
  4. Jenkins H., 2009, Fans, blogueros y videojuegos: La cultura de la colaboración
  5. Marten H., 2010, Journal of Media Literacy Education, 2, 1
  6. Wilson C., 2011, Alfabetización mediática informacional. Curriculum para profesores

Cited by

Sorted by citations

Metadata

Authors
Cuervo Sánchez, S. L., Foronda Rojo, A., Rodríguez Martínez, A., & Medrano Samaniego, C.
Affiliations
  • Faculty of Education, Philosophy and Anthropology, University of the Basque Country (UPV/EHU), Leioa, Spain
  • School of Education, Pontifical Catholic University of Ecuador in Esmeraldas, Esmeraldas, Ecuador
  • Department of Education, University of Zaragoza, Zaragoza, Spain
Venue
Educational Review
Published
2019-08-07
Volume
73
Issue
4
Pages
487-502
ISSN
  • 0013-1911 (ISSN-L)
  • 1465-3397
OpenAlex
W2965086729
Cited by
42
References
28
Citations by year
2026: 5 · 2025: 11 · 2024: 9 · 2023: 9 · 2022: 6 · 2021: 1 · 2020: 1
FWCI
4.38
Type
journal article
Language
en
Open access
Licence
cc-by-nc-nd
Locations
  • Educational Review (publishedVersion)
  • Zaguan (Universidad de Zaragoza) (submittedVersion, cc-by-nc-nd)
  • Communities in ADDI (University of the Basque Country) (submittedVersion, other-oa)
  • Hispana (submittedVersion, other-oa)
Topics
  • Social Sciences › Education › Literacy, Media, and Education
  • Social Sciences › Library and Information Sciences › Library Science and Information Literacy
  • Social Sciences › Education › Education and Digital Technologies
Keywords
media and information literacy, adolescents, questionnaire development, psychometric validation, reliability and validity, critical comprehension, media production, educommunication

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

A language model drew the claims from the paper on 2026-11-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-11-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review