Graphical abstracts are associated with greater Altmetric attention scores, but not citations, in sport science
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index; 20 of the 27 sources its claims cite were checked for support.
Abstract
This paper aimed to determine if papers published with a Graphical abstract (GA) in the sport science field were associated with higher Altmetric attention scores and more citations than papers published without. A multivariate negative binomial mixed effects model was used to determine whether Altmetric attention scores and citation counts were different between articles published with or without a GA longitudinally over five timepoints. Included articles were published between January 2019 and December 2020 from three journals ranked within the top quartile of the category of “Sport Science”. Of 562 articles, 96 were published with a GA. Articles with GA were associated with higher Altmetric attention score than those without (incidence rate ratio 1.89 [95% confidence interval [CI] 1.25–2.85]; p = 0.003; small effect), with no difference in citations (incidence rate ratio 0.97 [95% CI 0.72–1.30]; p = 0.829; trivial effect). This study suggests that publishing with a GA is associated with increased Altmetric attention scores, but not citations, in sport science. This may indicate that GAs improve research dissemination amongst the public, which is important in practical fields.
Overview
CoChat Summary
TL;DR
In sport science articles, publishing with a graphical abstract was associated with higher Altmetric attention scores but not more citations. The authors used a longitudinal multivariate negative binomial mixed effects model across three top-quartile sport science journals.
Key findings
- Articles with a graphical abstract had higher Altmetric attention scores than those without: incidence rate ratio 1.89 (95% CI 1.25–2.85; p = 0.003; small effect).
- There was no difference in citations between articles with and without a graphical abstract: incidence rate ratio 0.97 (95% CI 0.72–1.30; p = 0.829; trivial effect).
- Open access was associated with higher Altmetric attention scores (IRR 1.81, 95% CI 1.32–2.50; p = 0.001) and more citations (IRR 1.48, 95% CI 1.18–1.86; p = 0.001).
- Reviews had higher Altmetric attention scores (IRR 2.51, 95% CI 1.75–3.62; p < 0.001) and more citations (IRR 3.01, 95% CI 2.32–3.90; p < 0.001) than original articles. Of the 557 articles analyzed, 96 were published with a graphical abstract.
Methods
- Longitudinal study of full-text articles published between January 2019 and December 2020 in three journals ranked in the top quartile of “Sport Science” that had published graphical abstracts since January 2019 or earlier: Journal of Sport and Health Sciences, Exercise and Sport Science Reviews, and Psychology of Sport and Exercise.
- Article data, Altmetric attention scores, and citations were extracted at four timepoints: 11 January 2022, 27 May 2022, 15 August 2022, and 21 March 2023. Graphical abstract status was identified manually; citations were counted using Dimensions software via Altmetric Explorer.
- A negative binomial mixed effects model examined associations with Altmetric attention score and citation counts. Days since publication and journal were covariates, publication ID was a random effect, and significant variables were included in a final multivariate analysis. Effect sizes were quantified using incidence rate ratios.
Limitations
- The paper states that graphical abstract quality was not accounted for, video abstracts were not examined because of their small volume in sport science, and other variables such as number of authors, collaboration type, number of cited references, publication length, title length, author affiliations, and specific topics were not included.
- The paper states that a longer observation period may be needed for citations, since citation accumulation is slower than Altmetric attention, and that previous studies were cross-sectional or did not always account for time since publication.
- Evident from the text: the abstract reports 562 articles, while the Results section reports 557 articles analyzed after exclusions; the study is also limited to three sport science journals, so findings may not generalize to other fields.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
11 Valid · 3 Not valid · 3 Not checked · 22 Own results and interpretations
Some cited sources support this claim and some don’t — read each source’s verdict below.
In the paper
“The effect of GAs on citation counts is unclear, largely due to the conflicting results presented in the research”
What the sources say
- Partly supportedcites Aggarwal, 2021 sourceExperimental — accuracy not yet measured
The Discussion reports differing citation-count results within this study: overall citations favored papers without visual abstracts, while an RCT subgroup result was borderline significant in the other direction. It also says more evidence is needed before reaching a conclusion. The paper does not establish that conflicting results across the research literature are largely why the effect on citation counts is unclear. (LLM, conf=0.79)
- Supportedcites Bennett & Slattery, 2022 source
The Discussion (p. 7) states verbatim: 'The effect of GAs on citation counts is unclear, largely due to the conflicting results presented in the research,' followed by the enumeration of negative (Aggarwal 2021; Bennett & Slattery 2022; Pferschy-Wenzig et al. 2016), null (present study) and positive (Kim et al. 2022) associations. The Context (p. 2) and Discussion (pp. 7-8) passages reinforce the same conflicting-results framing, so the paraphrase faithfully reproduces what this source reports. (LLM, conf=0.95)
- Disputedcites Pferschy-Wenzig et al., 2016 sourceExperimental — accuracy not yet measured
The Background says the authors found no prior study of graphical abstracts’ impact on publication visibility, rather than conflicting research results. The Conclusions and Outlook cautions that their own finding—fewer citations for papers with graphical abstracts—comes from one journal and a limited timeframe. That limitation leaves the broader effect uncertain, but it does not support the claimed reason for the uncertainty. (LLM, conf=0.88)
Checked by a reasoning model — may be wrong.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Based on this small body of research, it appears that graphical abstracts do outperform text-based posts on Twitter”
What the sources say
- Not checked — no full text of the sourcecites Ibrahim et al., 2017 source
- Supportedcites Chapman et al., 2019 source
The Results section (“Total engagement, public engagement and healthcare professional engagement”; page unavailable) reports significantly more total engagements for visual abstracts than for plain English abstracts on Twitter (P = 0.001). This supports the hedged comparison, with outperformance measured as engagement with tweets about surgical research. (LLM, conf=0.86)
- Supportedcites Hoffberg et al., 2020 source
The Results report significantly more impressions, retweets, and link clicks for visual-abstract tweets than for text-abstract tweets. The Conclusions say this finding aligns with prior studies, supporting the citing sentence’s cautious summary of a small body of research. Page numbers are not provided in our copy. (LLM, conf=0.91)
hedgedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Articles with GA were associated with higher Altmetric attention score than those without (incidence rate ratio 1.89 [95% confidence interval [CI] 1.25-2.85]; p = 0.003; small effect)”
- Also stated in: § Discussion · p. 7 · plain
“As hypothesised, including a GA with the publication of an article in three high-ranking sport science-related journals was associated with higher Altmetric attention scores.”
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Discussion · p. 7 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“with no difference in citations (incidence rate ratio 0.97 [95% CI 0.72-1.30]; p = 0.829; trivial effect)”
- Also stated in: § Discussion · p. 7 · plain
“However, this finding was not repeated with respect to citations counts, where there were no differences observed between articles published with or without a GA.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § Discussion · p. 7 · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The results of this longitudinal study suggest that graphical and video abstracts are associated with larger Altmetric attention scores, but not citation counts, in the field of sports science.”
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
1 more claim
Create a free account to see all 39 claims and every source verdict.
- It may state two separate claims as one. 15
- Probably not a substantial claim. 28
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
§ Conclusions · p. 10
“The results of this longitudinal study suggest that graphical and video abstracts are associated with larger Altmetric attention scores, but not citation counts, in the field of sports science.”
§ Discussion · p. 9
“It is also important to note that this study did not examine the effect of publishing with a VA on relevant article metrics.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Discussion · p. 7
“articles published with a GA were associated with lower Altmetric attention scores and citations counts than those published with a GA”
§ Context · p. 2
“articles with a GA were associated with lower citations, and lower Altmetric attention scores, than those published without a GA (Bennett & Slattery, 2022).”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Results · p. 6
“| Editorial etc. | 1.25 (0.77-2.06) | 0.371 | Small |”
§ Methods · p. 3
“trivial (0.77-1.00 or 1.00-1.29), small (0.51-0.78 or 1.30-1.99)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Results · p. 4
“letters to the editor (IRR 1.28 [95% CI 0.56-2.94]; p = 0.559; small effect )”
§ Methods · p. 3
“trivial (0.77-1.00 or 1.00-1.29), small (0.51-0.78 or 1.30-1.99)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Results · p. 6
“Table 3 Multivariate negative binomial regression exploring the impact of article type, open access status, and abstract type (normal; graphical abstract; video abstract) on Altmetric attention scores and citation counts”
§ Results · p. 4
“Three were excluded due to being 'notes from the editor,' five were excluded due to being published with video abstracts, leaving 557 articles for analysis (Table 1).”
Citations
Cites
A review of the literature on citation impact indicators
Waltman, L. (2016) · Journal of Informetrics · doi:10.1016/j.joi.2016.02.007 · Cited by 1,356 · cited 2×
“, time period after publication in which an article can be cited) is known to influence citation counts (Waltman, 2016).”
BackgroundGauchat, G. (2012) · American Sociological Review · doi:10.1177/0003122412438225 · Cited by 1,091 · cited 1×
“While science has long been of interest to the public (Gauchat, 2012), its accessibility has traditionally been limited to those within academic circles.”
BackgroundDo Altmetrics Work? Twitter and Ten Other Social Web Services
Thelwall, M., Haustein, S., Larivière, V., & Sugimoto, C. R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0064841 · Cited by 907 · cited 1×
“A 12-month timeframe was deemed appropriate to provide an accurate indication of Altmetric attention score and citations considering there appears to be a quick uptake of attention-based indicators after publication (Thelwall et al., 2013), and that short-term citation counts are highly correlated with long-term citat…”
BackgroundOnline collaboration: Scientists and the social network
Van Noorden, R. (2014) · Nature · doi:10.1038/512126a · Cited by 654 · cited 1×
“…coinciding with an increased emphasis on alternative metrics, there has been a recent shift in the way the public access and interact with science, largely driven by social media becoming an important vehicle for science communication (Huber et al., 2019; Rowlands et al., 2011; Van Noorden, 2014).”
BackgroundBornmann, L. (2014) · Journal of Informetrics · doi:10.1016/j.joi.2014.09.005 · Cited by 578 · cited 1×
“…GPO Box 2471, Adelaide 5001, Australia 2 Alliance for Research in Exercise, Nutrition, and Activity (ARENA), University of South Australia, Adelaide, Australia 3 Central Adelaide Local Health Network (CALHN), Adelaide, SA 5000, Australia 1 3 channels as a proxy for social impact (Bornmann, 2014).”
BackgroundSocial media use in the research workflow
ROWLANDS, I., NICHOLAS, D., RUSSELL, B., CANTY, N., & WATKINSON, A. (2011) · Learned Publishing · doi:10.1087/20110306 · Cited by 340 · cited 1×
“However, coinciding with an increased emphasis on alternative metrics, there has been a recent shift in the way the public access and interact with science, largely driven by social media becoming an important vehicle for science communication (Huber et al., 2019; Rowlands et al., 2011; Van Noorden, 2014).”
BackgroundDimensions: A competitor to Scopus and the Web of Science?
Thelwall, M. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.03.006 · Cited by 294 · cited 1×
“Citations extracted from Altmetric explorer are counted using Dimensions software, which has been shown to have comparable capture to Web of Science and Scopus (Harzing, 2019; Thelwall, 2018).”
MethodIbrahim, A. M., Lillemoe, K. D., Klingensmith, M. E., & Dimick, J. B. (2017) · Annals of Surgery · doi:10.1097/sla.0000000000002277 · Cited by 268 · cited 4×
“Compared to tweeting the article title alone, tweets featuring a visual abstract experienced a more than sevenfold increase in impressions, an eightfold increase in retweets, and a twofold increase in article visits (Ibrahim et al., 2017).”
BackgroundMethodInfluentialFostering public trust in science: The role of social media
Huber, B., Barnidge, M., Gil de Zúñiga, H., & Liu, J. (2019) · Public Understanding of Science · doi:10.1177/0963662519869097 · Cited by 231 · cited 1×
“However, coinciding with an increased emphasis on alternative metrics, there has been a recent shift in the way the public access and interact with science, largely driven by social media becoming an important vehicle for science communication (Huber et al., 2019; Rowlands et al., 2011; Van Noorden, 2014).”
BackgroundHarzing, A.-W. (2019) · Scientometrics · doi:10.1007/s11192-019-03114-y · Cited by 164 · cited 1×
“Citations extracted from Altmetric explorer are counted using Dimensions software, which has been shown to have comparable capture to Web of Science and Scopus (Harzing, 2019; Thelwall, 2018).”
Method
Research works printed but not linked: 2
- Altmetric. (2021). How is the Altmetric attention score calculated? Altmetric.
- Johnson, R., Watkinson, A., & Mabe, M. (2018). The STM report: An overview of scientific and scholarly publishing. International Association of Scientific, 5, 212.
Cited by
Ten simple rules for designing graphical abstracts
Jambor, H. K., & Bornhäuser, M. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011789 · Cited by 32
“However, early analyses indicate that while graphical abstracts do not necessarily increase full-text reads or citations, they do enhance the abstract views [5] and boost altimetric attention scores of articles [6].”
BackgroundIn a blink of an eye: Graphical abstracts in Advances in Clinical and Experimental Medicine
Misiak, M., & Kurpas, D. (2023) · Advances in Clinical and Experimental Medicine · doi:10.17219/acem/171615 · Cited by 8
Prevalence and characteristics of graphical abstracts in a specialist pharmacology journal
Gilling, R., Scandlyn, M., & Hesp, B. R. (2024) · Scientometrics · doi:10.1007/s11192-024-05146-5 · Cited by 5
“This may contribute to conflicting reports regarding whether developing a GA translates into increased citations (Bennett & Slattery, 2023; Hoffberg et al., 2020; Kim et al., 2022).”
Science Communication at Historical Biology
Cooper, J. A. (2025) · Historical Biology · doi:10.1080/08912963.2025.2471234 · Cited by 1
“Various analyses have found that while the inclusion of a graphical abstract does not always lead to increased downloads or citations (Bennett & Slattery, 2023; Pferschy-Wenzig et al., 2016; Zong et al., 2023); it does generally lead to significantly higher altmetric scores, reflecting higher media…”
The evolution of abstracts in surgery
Emile, S. H., Behrns, K. E., & Wexner, S. D. (2023) · Surgery · doi:10.1016/j.surg.2023.09.026
Metadata
- Authors
- Bennett, H., & Slattery, F.
- Affiliations
- University of South Australia (AU)
- Corresponding author
- Bennett, Hunter
- Venue
- Scientometrics
- Published
- 2023-04-24
- Volume
- 128
- Issue
- 6
- Pages
- 3793-3804
- ISSN
- 0138-9130 (ISSN-L)
- 1588-2861
- OpenAlex
- W4366827816
- Semantic Scholar
- cbe0a6ce0e32b1744a7e26cc1c137c377996bed7
- Cited by
- 8
- References
- 35
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 2 · 2023: 3
- FWCI
- 1.49
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Scientometrics (publishedVersion, cc-by)
- UniSA Research Outputs Repository (University of South Australia) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion, cc-by)
- Funders
- University of South Australia
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- graphical abstracts, Altmetric Attention Score, citation counts, sports science, research dissemination, scholarly communication, open science practices
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Graphical abstracts are associated with greater Altmetric attention scores, but not citations, in sport science. https://app.cochat.ai/papers/10.1007/s11192-023-04709-2
- The paper
- Bennett, H., & Slattery, F. (2023). Graphical abstracts are associated with greater Altmetric attention scores, but not citations, in sport science. Scientometrics. https://doi.org/10.1007/s11192-023-04709-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.