The DOI matches its Crossref record; the references it cites are not checked yet.
Trusted Media Challenge Dataset and User Study
Open accessAbstract
The emergence of fake media that can be easily created by technology has the potential to generate potent misinformation causing harm to both society and individuals. To tackle the issue, we have organized the Trusted Media Challenge (TMC) to explore how Artificial Intelligence (AI) technologies could be leveraged to combat fake media. To enable further research, we are releasing the dataset from the TMC, consists of 4,380 fake and 2,563 real videos, with various video and audio manipulation methods employed to produce different types of fake media. We have also carried out a user study to demonstrate the quality of the TMC dataset and to compare the performance of humans and AI models. The results show that the TMC dataset can fool human participants in many cases. The TMC dataset is available for research purposes upon request via [email protected]
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Higher-quality deepfakes are associated with fewer visual artifacts, making them more di ffi cult to detect [20, 35, 36, 42].”
From Human Performance in Deepfake Detection: A Systematic Review (2025) · cites this paper as [20]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Second, while lower-quality deepfakes are generally easier to detect [20, 35, 36, 42], imperfections in authentic videos (e.g., lighting inconsistencies or unusual framing) can lead viewers to miscategorize genuine content as manipulated [2, 22, 27, 35, 37].”
From Human Performance in Deepfake Detection: A Systematic Review (2025) · cites this paper as [20]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Chen et al. [20] found that the best machine learning detection model achieved an AUC of 0.985. In comparison, the overall human performance scored an AUC of 0.870.”
From Human Performance in Deepfake Detection: A Systematic Review (2025) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“Media were sourced from various datasets including DFDC [9], Perceptual Experiments on Face Swaps (PEFS) [19], trusted media challenge (TMC) [20], FaceForensics++ + [21], and Celeb-DF [10].”
From Human Performance in Deepfake Detection: A Systematic Review (2025) · cites this paper as [20]
The cited source says what the claim attributes to it.
In the citing paper
“Lip-syncs are easier to detect when there are unnatural or inconsistent lip/mouth movements [20, 30, 7, 28].”
From Human Performance in Deepfake Detection: A Systematic Review (2025) · cites this paper as [20]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
The citation lists are queued
They are fetched later and appear here then.
References 24 · Cited by 7
Research works printed but not linked: 3
- Abigail Toh . Aisg launches ''prize challenge" to curate ideas and ai models to combat fake media. https://aisingapore.org/2021/07/aisg-launches-prize-challengeto-curate-ideas-and-ai-models-to-combat-fake-media/ , 2022 . Accessed March 7, 2022. Abigail Toh. Aisg launches ''prize challenge" to curate ideas and ai models to combat fake media. https://aisingapore.org/2021/07/aisg-launches-prize-challengeto-curate-ideas-and-ai-models-to-combat-fake-media/, 2022. Accessed March 7, 2022.
- Nick Dufour and Andrew Gully . Contributing data to deepfake detection research. https://ai.googleblog.com/2019/09/contributing-data-to-deepfakedetection.html, 2022 . Accessed Apr 30, 2022 . Nick Dufour and Andrew Gully. Contributing data to deepfake detection research. https://ai.googleblog.com/2019/09/contributing-data-to-deepfakedetection.html, 2022. Accessed Apr 30, 2022.
- Hyeongwoo Kim , Pablo Garrido , Ayush Tewari , Weipeng Xu , Justus Thies , Matthias Niessner , Patrick Pérez , Christian Richardt , Michael Zollhöfer , and Christian Theobalt . Deep video portraits. ACM Transactions on Graphics (TOG), 37(4):1--14 , 2018 . Hyeongwoo Kim, Pablo Garrido, Ayush Tewari, Weipeng Xu, Justus Thies, Matthias Niessner, Patrick Pérez, Christian Richardt, Michael Zollhöfer, and Christian Theobalt. Deep video portraits. ACM Transactions on Graphics (TOG), 37(4):1--14, 2018.
Metadata
- Authors
- Chen, W., Chua, S. L. B., Winkler, S., & Ng, S.-K.
- Affiliations
- AI Singapore (SG)
- Venue
- Proceedings of the 31st ACM International Conference on Information & Knowledge Management
- Publisher
- ACM
- Published
- 2022-10-17
- Pages
- 3873-3877
- ISSN
- 2155-0751 (ISSN-L)
- OpenAlex
- W4292200154
- Cited by
- 7
- References
- 24
- Citations by year
- 2025: 3 · 2024: 2 · 2023: 2
- FWCI
- 5.44
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM International Conference on Information and Knowledge Management (CIKM) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Research Foundation, Singapore
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Digital Media Forensic Detection
- Physical Sciences › Computer Science › Information Systems › Spam and Phishing Detection
- Keywords
- fake media, misinformation, video manipulation, sound manipulation, deepfake detection, datasets, user study
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Trusted Media Challenge Dataset and User Study. https://app.cochat.ai/papers/10.1145/3511808.3557715
- The paper
- Chen, W., Chua, S. L. B., Winkler, S., & Ng, S.-K. (2022). Trusted Media Challenge Dataset and User Study. Proceedings of the 31st ACM International Conference on Information & Knowledge Management. https://doi.org/10.1145/3511808.3557715
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.