Augmenting Sports Videos with VisCommentator
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Visualizing data in sports videos is gaining traction in sports analytics, given its ability to communicate insights and explicate player strategies engagingly. However, augmenting sports videos with such data visualizations is challenging, especially for sports analysts, as it requires considerable expertise in video editing. To ease the creation process, we present a design space that characterizes augmented sports videos at an element-level (what the constituents are) and clip-level (how those constituents are organized). We do so by systematically reviewing 233 examples of augmented sports videos collected from TV channels, teams, and leagues. The design space guides selection of data insights and visualizations for various purposes. Informed by the design space and close collaboration with domain experts, we design VisCommentator, a fast prototyping tool, to eases the creation of augmented table tennis videos by leveraging machine learning-based data extractors and design space-based visualization recommendations. With VisCommentator, sports analysts can create an augmented video by selecting the data to visualize instead of manually drawing the graphical marks. Our system can be generalized to other racket sports (e.g., tennis, badminton) once the underlying datasets and models are available. A user study with seven domain experts shows high satisfaction with our system, confirms that the participants can reproduce augmented sports videos in a short period, and provides insightful implications into future improvements and opportunities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
You Only Look Once: Unified, Real-Time Object Detection
Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.91 · Cited by 53,803
Narrative Visualization: Telling Stories with Data
Segel, E., & Heer, J. (2010) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2010.179 · Cited by 1,334
Cited by
Li, H., Wang, Y., & Qu, H. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642726 · Cited by 77
Self-citationHow Does Automation Shape the Process of Narrative Visualization: A Survey of Tools
Chen, Q., Cao, S., Wang, J., & Cao, N. (2024) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3261320 · Cited by 71
“In addition, Chen et al. [118] developed VisCommentator, a tool for analyzing ball sports videos in sports programs, facilitating the creation of ball enhanced videos through data insights and visualization suggestions.”
MethodSNIL: Generating Sports News From Insights With Large Language Models
Cheng, L., Deng, D., Xie, X., Qiu, R., Xu, M., & Wu, Y. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3392683 · Cited by 18
“However, creating multi-modal data journalism, including text, images, charts, videos [75], and VR-embedded visualizations [26], remains challenging.”
Self-citationSocrates: Data Story Generation via Adaptive Machine-Guided Elicitation of User Feedback
Wu, G., Guo, S., Hoffswell, J., Chan, G. Y.-Y., Rossi, R. A., & Koh, E. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3327363 · Cited by 15
Lee, C., Lin, T., Pfister, H., & Zhu-Tian, C. (2025) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2024.3456332 · Cited by 7
“Aspects that involve more complex data, like game tactics and in-game decision-making, were only preliminary explored by Zhu-Tian et al. [68], which did not target sports fans.”
BackgroundMethodInfluential
Metadata
- Authors
- Zhu-Tian, C., Ye, S., Chu, X., Xia, H., Zhang, H., Qu, H., & Wu, Y.
- Venue
- IEEE Transactions on Visualization and Computer Graphics
- Published
- 2022-01
- Volume
- 28
- Issue
- 1
- Pages
- 824-834
- ISSN
- 1077-2626 (ISSN-L)
- 1941-0506
- 2160-9306
- OpenAlex
- W3202963651
- Cited by
- 60
- References
- 4
- FWCI
- 4.06
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Augmenting Sports Videos with VisCommentator. https://app.cochat.ai/papers/10.1109/tvcg.2021.3114806
- The paper
- Zhu-Tian, C., Ye, S., Chu, X., Xia, H., Zhang, H., Qu, H., & Wu, Y. (2022). Augmenting Sports Videos with VisCommentator. IEEE Transactions on Visualization and Computer Graphics. https://doi.org/10.1109/tvcg.2021.3114806
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.