The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index; 2 of the 42 sources its claims cite were checked for support.
How to debunk misinformation? An experimental online study investigating text structures and headline formats
Open accessAbstract
Objectives: Misinformation is a crucial problem, particularly online, and the success of debunking messages has so far been limited. In this study, we experimentally test how debunking text structure (truth sandwich vs. bottom‐heavy) and headline format (statement vs. questions) affect the belief in misinformation across topics of the safety of COVID vaccines and GMO foods. Design: Experimental online study. Methods: A representative German sample of 4906 participants were randomly assigned to reading one of eight debunking messages in the experimentally varied formats and subsequently rated the acceptance of this message and the agreement to misinformation statements about the mentioned topics and an unrefuted control myth. Results: While the debunking messages specifically decreased the belief in the targeted myth, these beliefs and the acceptance of the debunking message were unaffected by the text structures and headline formats. Yet, they were less successful when addressing individuals with strong pre‐existing, incongruent attitudes and distrust in science. Conclusions: The risk of backfire effects in debunking misinformation is low. Text structure and headline format are of relatively little importance for the effectiveness of debunking messages. Instead, writers may need to pay attention to the text being comprehensive, trustworthy and persuasive to maximize effectiveness.
Overview
CoChat Summary
TL;DR
In a representative German online experiment (N = 4906), debunking messages reduced agreement with the specific misinformation they addressed, but text structure (truth sandwich vs. bottom-heavy) and headline format (statement vs. question) had no meaningful effects. Debunking was less effective among people with low trust in science or attitudes incongruent with the correction, but there was little evidence of backfire.
Key findings
- Debunking texts specifically reduced belief in the targeted myth: agreement with COVID-19 vaccine misinformation was lower after the vaccine text than after the GMO text (b = −.41, t(4898) = −8.673, p < .001, d = −.25), and agreement with GMO misinformation was lower after the GMO text than after the vaccine text (b = .66, t(4898) = 17.904, p < .001, d = .51). Agreement with the unrefuted Vitamin C control myth did not differ by debunking text (b = .01, t(4898) = .382, p = .7026, d = .01).
- Text structure did not significantly affect agreement with misinformation (all effects involving text structure: F ≤ 1.96, ηp² < .001, p ≥ .142). Headline format had only a negligible effect: statement headlines slightly increased effectiveness of the fitting debunking message (headline format × debunk topic × myth topic: F(1.95, 9556.51) = 3.19, ηp² < .001, p = .043).
- The COVID-19 vaccine debunking text was evaluated more positively (M = 5.28, SD = 1.36) than the GMO text (M = 5.04, SD = 1.26; F(1, 4989) = 43.99, ηp² = .009, p < .001), and willingness to share was higher for the COVID-19 vaccine text (M = 3.77, SD = 1.65) than the GMO text (M = 3.34, SD = 1.54; F(1, 4989) = 88.50, ηp² = .018, p < .001).
- Debunking was less effective among participants with low trust in science (debunk topic × myth topic × trust: F(1.99, 9710.46) = 18.96, ηp² = .004, p < .001) and incongruent vaccination attitudes (F(1.96, 9483.53) = 8.93, ηp² = .002, p < .001); for GMO attitudes, the message was slightly more effective in individuals with lower GMO attitudes (F(1.96, 9483.53) = 6.09, ηp² = .001, p = .003). Message acceptance did not mediate effects on agreement with the myth (all |βy| ≤ .01, all p ≥ .137).
Methods
- Preregistered experimental online study with a representative German sample of N = 4906 (n = 613 per condition except one condition with n = 615), recruited via the ZPID PsychLab platform with quotas for gender, age, education, and household income. Participants were randomly assigned to one of eight debunking messages in a 2 Text Structure (truth sandwich vs. bottom-heavy) × 2 Headline Format (question vs. statement) × 2 Debunk Topic (COVID-19 vaccines vs. GMO food) between-subjects design.
- Primary outcome was agreement with misinformation statements about three myth topics (Vitamin C control, COVID-19 vaccines, GMO food) measured within participants on a 7-point Likert scale. Secondary outcomes were evaluation of the text (comprehensiveness, trustworthiness, persuasiveness) and perceived social impact (mentioning in personal communication and sharing on social media).
- Main analyses used mixed ANOVAs, exploratory GLMs, and mediation models with 10,000 bias-corrected bootstrap confidence intervals; the analyst conducting preregistered analyses was blinded to independent variables.
Limitations
- The paper states the study was cross-sectional and cannot provide insights into changes over time; immediate debunking effects could be obliterated over time by continued influence of misinformation. It also states that actual behavior was not assessed, and that the study was presented as conducted by a university research team, which may have been considered credible by most people; future studies could vary source credibility.
- The text makes evident that age data had an anomaly: n = 195 participants (4%) indicated they were 100 years old, so the paper reports full-sample analyses (N = 4906) as preregistered and supplementary analyses for participants aged 18–99 (N = 4711). The study is also limited to two debunking topics and a German sample, and forced responses were used throughout.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
2 Valid · 0 Not valid · 35 Not checked · 44 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This indicates that the content of the message needs to be carefully crafted and the quality of the information has more impact than formal structure (van der Linden, 2022).”
§ How to debunk misinformation? An experimental online study investigating text structures and headline formats > DISCUS SION
What the sources say
- Partly supportedcites van der Linden, 2022 sourceExperimental — accuracy not yet measured
The 'immunization' section does support the first half: it states that meta-analytic findings show 'the effectiveness of interventions is significantly attenuated by (1) the quality of the debunk, (2) the passing of time, and (3) prior beliefs and ideologies,' and the 'Warn about the myth' section urges carefully crafted debunking content (lead with the truth, coherent alternative causal explanation). However, no passage in our copy makes the comparative claim that information quality matters MORE than formal structure — on the contrary, the same section and Fig. 1 present structural rules (open with the facts, warn about the myth only once, end by reinforcing the facts) as best practice, and note that optimizing messages according to these guidelines enhances efficacy. The unsupported part of the claim is the quality-over-structure comparison; note also that the 'quality of the debunk' finding is reported here from others' meta-analyses (refs 87,88), which van der Linden relays rather than originates. (LLM, conf=0.72)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“This experimental study indicates that the risk of strengthening, rather than weakening, belief in misinformation due to repeating myths in refutation attempts is low, at least as long as an explanation for why the claim is false is included (Swire-Thompson et al., 2020).”
§ How to debunk misinformation? An experimental online study investigating text structures and headline formats > DISCUS SION
What the sources say
- Partly supportedcites Swire-Thompson et al., 2020 sourceExperimental — accuracy not yet measured
The Familiarity Backfire Effect section states that repetition-driven belief increases 'rarely, if ever, occurs when the misinformation is paired with a clear and salient correction' and that the familiarity backfire effect 'has little to no empirical support', and the Abstract/Practical Recommendations say avoiding repetition of the misconception 'appears to be unnecessary and could even hinder corrective efforts' — this supports the claim's core (low risk from repeating myths in refutations). The qualifier the claim attaches is not what the source says: its condition is a clear and salient pairing with the correction, not the inclusion of an explanation of why the claim is false; the same passage in fact cites Ecker, O'Reilly, Reid & Chang (2019) for a bare 'false' tag with no further explanation substantially reducing belief. Also, the source reaches this by synthesising others' studies (e.g., Walter & Tukachinsky's 10-study meta-analysis, Brashier et al. 2020) rather than reporting one original experiment, so 'this experimental study indicates' overstates its role. (LLM, conf=0.72)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Yet, they were less successful when addressing individuals with strong preexisting, incongruent attitudes and distrust in science.”
- Also stated in: § How are the outcomes related to each other and do the texts differentially mitigate confirmation bias effects? · plain
“both debunking texts were slightly less effective in people with low trust in science compared to high trust in science (debunk topic × myth topic × trust: F(1.99, 9710.46)= 18.96, η p 2 = .004,p < .001)”
§ How to debunk misinformation? An experimental online study investigating text structures and headline formats > Abstract
plainstates a causen = 4,906 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § How are the outcomes related to each other and do the texts differentially mitigate confirmation bias effects? · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While the debunking messages specifically decreased the belief in the targeted myth, these beliefs and the acceptance of the debunking message were unaffected by the text structures and headline formats.”
- Also stated in: § DISCUS SION · hedged
“Still, participants agreed less with the misinformation for which they were presented with a text compared to the other two topics, indicating that all interventions were successful.”
§ How to debunk misinformation? An experimental online study investigating text structures and headline formats > Abstract
plainstates a causen = 4,906- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § DISCUS SION · hedged
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“debunk topic: F(1, 4989) = 43.99,η p 2 = .009,p < .001)with no other statistically significant effects (all F(1, 4989) ≤ 2.36, all η p 2 > .001,p ≥ .124).”
§ How to debunk misinformation? An experimental online study investigating text structures and headline formats > Data analysis
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
38 more claims
Create a free account to see all 81 claims and to verify the 26 references still open.
- It may state two separate claims as one. 13
- Probably not a substantial claim. 28
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentt(4898) = 0.382reported p = .7026 · recomputed p = .702
“t(4898) = .382,p = .7026”
- Consistentt(4898) = -8.673reported p < .001 · recomputed p < .001
“t(4898) = -8.673,p < .001”
- Consistentt(4898) = 17.904reported p < .001 · recomputed p < .001
“t(4898) = 17.904, p < .001”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“debunk topic: F(1, 4989) = 10.71,η p 2 = .002,p = .001”
§ How to debunk misinformation? An experimental online study investigating text structures and headline formats > Additional information
Reported 4989 · recomputed 4898
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
Misinformation and Its Correction: Continued Influence and Successful Debiasing
Lewandowsky, S., Ecker, U. K. H., Seifert, C. M., Schwarz, N., & Cook, J. (2012) · Psychological Science in the Public Interest · doi:10.1177/1529100612451018 · Cited by 2,920
The spreading of misinformation online
Del Vicario, M., Bessi, A., Zollo, F., Petroni, F., Scala, A., Caldarelli, G., Stanley, H. E., & Quattrociocchi, W. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1517441113 · Cited by 2,407
Measuring the impact of COVID-19 vaccine misinformation on vaccination intent in the UK and USA
Loomba, S., de Figueiredo, A., Piatek, S. J., de Graaf, K., & Larson, H. J. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01056-1 · Cited by 1,800
The psychological drivers of misinformation belief and its resistance to correction
Ecker, U. K. H., Lewandowsky, S., Cook, J., Schmid, P., Fazio, L. K., Brashier, N., Kendeou, P., Vraga, E. K., & Amazeen, M. A. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-021-00006-y · Cited by 1,372
Pennycook, G., & Rand, D. G. (2021) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2021.02.007 · Cited by 1,360
Facts and Fears: Understanding Perceived Risk
Slovic, P., Fischhoff, B., & Lichtenstein, S. (1980) · Societal Risk Assessment · doi:10.1007/978-1-4899-0445-4_9 · Cited by 1,188
afex: Analysis of Factorial Experiments
Singmann, H., Bolker, B., Westfall, J., Aust, F., & Ben-Shachar, M. S. (2012) · CRAN: Contributed Packages · doi:10.32614/cran.package.afex · Cited by 773
Imhoff, R., & Lamberty, P. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550620934692 · Cited by 722
Research works printed but not linked: 3
- Anderson E. R. Horton W. S. &Rapp D. N.(2019).Hungry for the Truth: Evaluating the Utility of “Truth Sandwiches” as Refutations. Annual meeting of the society for text and discourse https://www.researchgate.net/profile/William‐Horton‐4/publication/334491502_Hungry_for_the_Truth_Evaluating_the_Utility_of_Truth_Sandwiches_as_Refutations/links/5d2de48092851cf44089eab7/Hungry‐for‐the‐Truth‐Evaluating‐the‐Utility‐of‐Truth‐Sandwiches‐as‐Refutations.pdf
- Conner M., 2005, Predicting health behaviour, 121
- Lewandowsky S., 2020, The Debunking Handbook 2020
Cited by
Effective correction of misinformation
Prike, T., & Ecker, U. K. H. (2023) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2023.101712 · Cited by 74
van der Linden, S., Albarracín, D., Fazio, L. K., Freelon, D., Roozenbeek, J., Swire‐Thompson, B., & Bavel, J. J. V. (2023) · PsycEXTRA Dataset · doi:10.1037/e506432023-001 · Cited by 34
Dalmonte, E. F., Siqueira, E., & Silva, G. D. S. (2023) · Reciis · doi:10.29397/reciis.v17i3.3821 · Cited by 18
Debunking nutrition myths: An experimental test of the ‘truth sandwich’ text format
König, L. M. (2023) · British Journal of Health Psychology · doi:10.1111/bjhp.12665 · Cited by 16
Self-citationTulin, M., Hameleers, M., de Vreese, C. H., Opgenhaffen, M., & Wouters, F. (2024) · Journalism Practice · doi:10.1080/17512786.2024.2311311 · Cited by 16
Metadata
- Authors
- Kotz, J., Giese, H., & König, L. M.
- Affiliations
- University of Konstanz (DE)
- University of Bayreuth (DE)
- Corresponding author
- König, Laura M.
- Venue
- British Journal of Health Psychology
- Publisher
- Wiley
- Published
- 2023-06
- Volume
- 28
- Issue
- 4
- Pages
- 1097-1112
- ISSN
- 1359-107X (ISSN-L)
- 2044-8287
- OpenAlex
- W4379094875
- Cited by
- 31
- References
- 50
- Citations by year
- 2026: 11 · 2025: 12 · 2024: 4 · 2023: 4
- FWCI
- 9.21
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- British Journal of Health Psychology (publishedVersion, cc-by)
- PubMed (publishedVersion)
- EPub Bayreuth (University of Bayreuth) (submittedVersion, other-oa)
- KOPS (University of Konstanz) (submittedVersion, cc-by)
- Topics
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Communication › Communication and COVID-19 Impact
- Keywords
- misinformation debunking, belief in misinformation, backfire effect, distrust of science, message acceptance
- MeSH terms
- COVID-19, Communication, Humans, Persuasive Communication
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-11-16, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-16 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How to debunk misinformation? An experimental online study investigating text structures and headline formats. https://app.cochat.ai/papers/10.1111/bjhp.12670
- The paper
- Kotz, J., Giese, H., & König, L. M. (2023). How to debunk misinformation? An experimental online study investigating text structures and headline formats. British Journal of Health Psychology. https://doi.org/10.1111/bjhp.12670
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.