Is this recommended by an algorithm? The development and validation of the algorithmic media content awareness scale (AMCA-scale)
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Online media platforms are increasingly using algorithms to select and present relevant information to their audiences. This highlights the importance of exploring whether people are aware of algorithmic content recommendations. Although some studies have already investigated algorithmic awareness, no standardized instrument has been developed yet to assess this construct. In this study, we therefore developed and validated the Algorithmic Media Content Awareness Scale (AMCA-scale). This scale contains four underlying dimensions: 1) users’ awareness of content filtering, 2) users’ awareness of automated decision-making, 3) users’ awareness of human-algorithm interplay, and 4) users’ awareness of ethical considerations. In validating the scale, results revealed strong psychometrics properties. The AMCA-scale was also successfully tested for three different online platforms: Facebook, YouTube, and Netflix, showing its robustness over different environments. Based on these findings, we conclude that the AMCA-scale offers scholars a valid, reliable and robust tool to measure algorithmic awareness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709
Structural equation models with unobservable variables and measurement error: Algebra and statistics
Fornell, C., & Larcker, D. F. (1981) · Journal of Marketing Research · doi:10.1177/002224378101800313 · Cited by 13,287
Polit, D. F., & Beck, C. T. (2006) · Research in Nursing & Health · doi:10.1002/nur.20147 · Cited by 7,510 · cited 3×
“To quantify this content validity step, we used the Content Validity Index on the item level (I-CVI; see Lynn, 1986; Polit & Beck, 2006).”
MethodDetermination and Quantification Of Content Validity
LYNN, M. R. (1986) · Nursing Research · doi:10.1097/00006199-198611000-00017 · Cited by 6,775
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00149 · Cited by 5,925
A Brief Tutorial on the Development of Measures for Use in Survey Questionnaires
Hinkin, T. R. (1998) · Organizational Research Methods · doi:10.1177/109442819800100106 · Cited by 4,095
Scale Development Research: A Content Analysis and Recommendations for Best Practices
Worthington, R. L., & Whittaker, T. A. (2006) · The Counseling Psychologist · doi:10.1177/0011000006288127 · Cited by 4,087
Algorithm aversion: People erroneously avoid algorithms after seeing them err.
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015) · Journal of Experimental Psychology: General · doi:10.1037/xge0000033 · Cited by 3,232
van Dijck, J., Poell, T., & de Waal, M. (2018) · doi:10.1093/oso/9780190889760.001.0001 · Cited by 2,951
Content validity in psychological assessment: A functional approach to concepts and methods.
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995) · Psychological Assessment · doi:10.1037//1040-3590.7.3.238 · Cited by 2,387
Cited by
Voorveld, H. A. M., Meppelink, C. S., & Boerman, S. C. (2024) · International Journal of Advertising · doi:10.1080/02650487.2023.2264045 · Cited by 62
Self-citationThe validation of the Perceived Surveillance Scale
Segijn, C. M., Opree, S. J., & Van Ooijen, I. (2022) · Cyberpsychology: Journal of Psychosocial Research on Cyberspace · doi:10.5817/cp2022-3-9 · Cited by 41
Development and Validation of the Programming Anxiety Scale
YILDIRIM, O. G., & OZDENER, N. (2022) · International Journal of Computer Science Education in Schools · doi:10.21585/ijcses.v5i3.140 · Cited by 18
Wang, S., Huang, S., Zhou, A., & Metaxa, D. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3687046 · Cited by 11
Metadata
- Authors
- Zarouali, B., Boerman, S. C., & de Vreese, C. H.
- Venue
- Telematics and Informatics
- Publisher
- Elsevier BV
- Published
- 2021-09
- Volume
- 62
- Pages
- 101607
- ISSN
- 0736-5853 (ISSN-L)
- OpenAlex
- W3144032957
- Cited by
- 155
- References
- 27
- FWCI
- 21.32
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Is this recommended by an algorithm? The development and validation of the algorithmic media content awareness scale (AMCA-scale). https://app.cochat.ai/papers/10.1016/j.tele.2021.101607
- The paper
- Zarouali, B., Boerman, S. C., & de Vreese, C. H. (2021). Is this recommended by an algorithm? The development and validation of the algorithmic media content awareness scale (AMCA-scale). Telematics and Informatics. https://doi.org/10.1016/j.tele.2021.101607
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.