Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; the references it cites are not checked yet.

Trusted Media Challenge Dataset and User Study

Open access
Chen, Weiling, Chua, Sheng Lun Benjamin, Winkler, Stefan, Ng, See-Kiong · 2022 · Proceedings of the 31st ACM International Conference on Information & Knowledge Management

Abstract

The emergence of fake media that can be easily created by technology has the potential to generate potent misinformation causing harm to both society and individuals. To tackle the issue, we have organized the Trusted Media Challenge (TMC) to explore how Artificial Intelligence (AI) technologies could be leveraged to combat fake media. To enable further research, we are releasing the dataset from the TMC, consists of 4,380 fake and 2,563 real videos, with various video and audio manipulation methods employed to produce different types of fake media. We have also carried out a user study to demonstrate the quality of the TMC dataset and to compare the performance of humans and AI models. The results show that the TMC dataset can fool human participants in many cases. The TMC dataset is available for research purposes upon request via [email protected]

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3511808.3557715

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

4 more claims about this paper

Create a free account to see every claim other papers make about this one.

See all claims — free account

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

The citation lists are queued

They are fetched later and appear here then.

References 24 · Cited by 7

Research works printed but not linked: 3

  1. Abigail Toh . Aisg launches ''prize challenge" to curate ideas and ai models to combat fake media. https://aisingapore.org/2021/07/aisg-launches-prize-challengeto-curate-ideas-and-ai-models-to-combat-fake-media/ , 2022 . Accessed March 7, 2022. Abigail Toh. Aisg launches ''prize challenge" to curate ideas and ai models to combat fake media. https://aisingapore.org/2021/07/aisg-launches-prize-challengeto-curate-ideas-and-ai-models-to-combat-fake-media/, 2022. Accessed March 7, 2022.
  2. Nick Dufour and Andrew Gully . Contributing data to deepfake detection research. https://ai.googleblog.com/2019/09/contributing-data-to-deepfakedetection.html, 2022 . Accessed Apr 30, 2022 . Nick Dufour and Andrew Gully. Contributing data to deepfake detection research. https://ai.googleblog.com/2019/09/contributing-data-to-deepfakedetection.html, 2022. Accessed Apr 30, 2022.
  3. Hyeongwoo Kim , Pablo Garrido , Ayush Tewari , Weipeng Xu , Justus Thies , Matthias Niessner , Patrick Pérez , Christian Richardt , Michael Zollhöfer , and Christian Theobalt . Deep video portraits. ACM Transactions on Graphics (TOG), 37(4):1--14 , 2018 . Hyeongwoo Kim, Pablo Garrido, Ayush Tewari, Weipeng Xu, Justus Thies, Matthias Niessner, Patrick Pérez, Christian Richardt, Michael Zollhöfer, and Christian Theobalt. Deep video portraits. ACM Transactions on Graphics (TOG), 37(4):1--14, 2018.

Metadata

Authors
Chen, W., Chua, S. L. B., Winkler, S., & Ng, S.-K.
Affiliations
AI Singapore (SG)
Venue
Proceedings of the 31st ACM International Conference on Information & Knowledge Management
Publisher
ACM
Published
2022-10-17
Pages
3873-3877
ISSN
2155-0751 (ISSN-L)
OpenAlex
W4292200154
Cited by
7
References
24
Citations by year
2025: 3 · 2024: 2 · 2023: 2
FWCI
5.44
Type
conference paper
Language
en
Open access
Locations
  • ACM International Conference on Information and Knowledge Management (CIKM) (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
National Research Foundation, Singapore
Topics
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
  • Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
Keywords
fake media, misinformation, video manipulation, sound manipulation, deepfake detection, datasets, user study

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Trusted Media Challenge Dataset and User Study. https://app.cochat.ai/papers/10.1145/3511808.3557715
The paper
Chen, W., Chua, S. L. B., Winkler, S., & Ng, S.-K. (2022). Trusted Media Challenge Dataset and User Study. Proceedings of the 31st ACM International Conference on Information & Knowledge Management. https://doi.org/10.1145/3511808.3557715

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.