Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 31 of the 39 references it cites were found in a registry or an index; 19 of the 36 sources its claims cite were checked for support.

Quality, reliability, and treatment misinformation risk of epilepsy content on Chinese short-video platforms TikTok (Douyin) and Bilibili: a cross-sectional analysis

Open access
Zhang, Yuan-jie, Guo, Yue-ying, Wang, Yong · 2026 · Scientific Reports

Abstract

Epilepsy is one of the most prevalent chronic neurological disorders worldwide, affecting approximately 70 million people globally and imposing substantial burdens on patients, families, and healthcare systems. Its multifaceted treatment landscape spanning antiepileptic drug (AED) therapy, epilepsy surgery, ketogenic dietary therapy, and neuromodulation makes accurate health information critical for patient decision-making and treatment adherence. Short-video platforms such as TikTok (Douyin) and Bilibili have emerged as primary channels through which the public accesses health-related content, yet the quality and reliability of epilepsy-related content on these platforms remain largely unexamined. A cross-sectional content analysis was conducted. We systematically retrieved videos via keyword search on TikTok (Douyin) and Bilibili, using the terms "dianxian" (epilepsy) and "jingfeng" (seizure/convulsion). For each platform, we collected the top 100 unique videos ranked by the platform's default relevance algorithm, with duplicate results from the two search terms removed. After applying pre-specified inclusion and exclusion criteria, 182 videos were included in the final analysis. Two physicians independently assessed the videos using a multi-instrument framework with clear applicable boundaries: Global Quality Score (GQS, for overall educational quality across all content types), modified DISCERN (mDISCERN, exclusively for treatment information reliability), JAMA benchmark criteria (for source transparency, not direct clinical accuracy), and a novel Treatment Misinformation Risk Scale (TMRS, specifically for epilepsy treatment-related content). Inter-rater reliability was assessed using the intraclass correlation coefficient (ICC). Engagement metrics and uploader characteristics were also recorded, with sensitivity analyses performed to control for confounding from uneven content theme distribution between platforms. A total of 182 videos were analyzed (96 from TikTok, 86 from Bilibili). The overall educational quality was suboptimal (mean GQS: 2.65 ± 0.93; mDISCERN: 2.12 ± 0.89 for treatment-containing videos). Bilibili videos demonstrated significantly higher performance across all instruments: overall educational quality (GQS: 3.11 ± 0.87 vs. 2.24 ± 0.84, P < 0.001), treatment information reliability (mDISCERN: 2.56 ± 0.81 vs. 1.74 ± 0.76, P < 0.001), and source transparency (JAMA: 2.18 ± 0.72 vs. 1.42 ± 0.68, P < 0.001). The mean normalized TMRS score was 1.15 ± 0.62, with TikTok showing significantly higher treatment misinformation risk (1.41 ± 0.54) than Bilibili (0.86 ± 0.53, P < 0.001). TMRS scores were positively correlated with likes (rho = 0.46, P < 0.001), shares (rho = 0.43, P < 0.001), and comments (rho = 0.39, P < 0.001), while quality scores showed no significant correlation with engagement. Sensitivity analyses confirmed that the observed platform differences were not confounded by differences in content theme distribution. Epilepsy-related content on China's major short-video platforms is of concerningly poor quality, with treatment misinformation receiving disproportionately higher user engagement. These findings highlight the urgent need for collaborative efforts among neurologists, platform operators, and health authorities to improve the quality of epilepsy health information in the digital environment.

Overview

CoChat Summary

## TL;DR

This cross-sectional analysis of 182 epilepsy-related videos on TikTok (Douyin) and Bilibili found generally low educational quality and a moderate overall treatment misinformation risk, with Bilibili outperforming TikTok on quality and reliability. Treatment misinformation risk was positively correlated with engagement, suggesting a “quality-engagement paradox,” but the study design cannot establish causality.

## Key findings

  • Of 200 retrieved videos, 182 met inclusion criteria: 96 from TikTok and 86 from Bilibili.
  • Overall video quality was suboptimal: mean GQS was 2.65 ± 0.93 across all videos; among treatment-containing videos, mean mDISCERN was 2.12 ± 0.89.
  • Bilibili videos scored higher than TikTok on all main quality/reliability measures: GQS 3.11 ± 0.87 vs 2.24 ± 0.84, mDISCERN 2.56 ± 0.81 vs 1.74 ± 0.76, and JAMA 2.18 ± 0.72 vs 1.42 ± 0.68, all P < 0.001.
  • TikTok had higher treatment misinformation risk: normalized TMRS 1.41 ± 0.54 vs 0.86 ± 0.53 on Bilibili (P < 0.001). TMRS was positively correlated with likes (rho = 0.46), shares (rho = 0.43), and comments (rho = 0.39), all P < 0.001.
  • In multivariable analysis, Bilibili remained independently associated with higher GQS (beta = 0.52, 95% CI 0.23 to 0.81, P < 0.001) and lower TMRS (beta = -0.31, 95% CI -0.50 to -0.12, P = 0.002).

## Methods

  • Cross-sectional content analysis of publicly available short videos on TikTok (Douyin) and Bilibili, using Chinese search terms “dianxian” and “jingfeng.”
  • The study searched the top 100 unique relevance-ranked videos per platform; after deduplication and screening, 182 videos remained. Searches were done in parallel on December 15–17, 2025 using new non-logged-in accounts.
  • Two board-certified physicians independently rated videos using GQS, mDISCERN, JAMA, and a novel TMRS; statistical analysis used nonparametric tests, Spearman correlations, subgroup analyses, and multivariable linear regression adjusting for uploader source, duration, references, and verification status.

## Limitations

  • The paper explicitly states that the cross-sectional design captures only a snapshot and cannot establish temporal sequence, direction of effects, or causality.
  • Sampling was limited to actively searched, top 100 relevance-ranked videos, excluding recommendation-feed content, ultra-short/very long videos, and low-view “long-tail” content; the paper says this limits representativeness.
  • Residual confounding may remain despite adjustment; the paper also notes TMRS has not been externally validated and its thresholds were exploratory rather than definitive.
  • Evident from the text: the study was restricted to Chinese-language content on domestic platforms, so cross-cultural generalizability is limited.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/s41598-026-52532-5

Cites

31 of 39 references verified0 citation errors · 8 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 PRISMA flow diagram of the video selection process for epilepsy-related content on TikTok and Bilibili.
Fig. 1 PRISMA flow diagram of the video selection process for epilepsy-related content on TikTok and Bilibili.CC BY-NC-ND · PubMed Central

Verification

Claims the paper makes

12 Valid · 3 Not valid · 6 Not checked · 101 Own results and interpretations

51 more claims

Create a free account to see all 122 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 45
  • Probably not a substantial claim. 36

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

1 of 1

Citations

Cites

Show all 39 references

Metadata

Authors
Zhang, Y.-J., Guo, Y.-Y., & Wang, Y.
Affiliations
Shanghai Jiao Tong University (CN)
Corresponding author
  • Guo, Yue-ying
  • Wang, Yong
Venue
Scientific Reports
Published
2026-05-08
Volume
16
Issue
1
ISSN
2045-2322 (ISSN-L)
OpenAlex
W7160634592
Cited by
3
References
39
Citations by year
2026: 3
FWCI
21.66
Type
journal article
Language
en
Open access
Licence
Locations
  • Scientific Reports (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • PubMed Central (publishedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Topics
  • Social Sciences › Health › Social Media in Health Education
  • Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
  • Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
Keywords
epilepsy, health misinformation, short video platforms, Bilibili, online health information quality, antiepileptic drugs, ketogenic diet, epilepsy surgery, neuromodulation, DISCERN, source transparency, user engagement metrics, social media health education
MeSH terms
Digital Media, China, Communication, Cross-Sectional Studies, Epilepsy, Humans, Video Recording, Reproducibility of Results

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Quality, reliability, and treatment misinformation risk of epilepsy content on Chinese short-video platforms TikTok (Douyin) and Bilibili: a cross-sectional analysis. https://app.cochat.ai/papers/10.1038/s41598-026-52532-5
The paper
Zhang, Y.-J., Guo, Y.-Y., & Wang, Y. (2026). Quality, reliability, and treatment misinformation risk of epilepsy content on Chinese short-video platforms TikTok (Douyin) and Bilibili: a cross-sectional analysis. Scientific Reports. https://doi.org/10.1038/s41598-026-52532-5

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.