Chart-to-Text: Generating Natural Language Descriptions for Charts by Adapting the Transformer Model
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Information visualizations such as bar charts and line charts are very popular for exploring data and communicating insights.Interpreting and making sense of such visualizations can be challenging for some people, such as those who are visually impaired or have low visualization literacy.In this work, we introduce a new dataset and present a neural model for automatically generating natural language summaries for charts.The generated summaries provide an interpretation of the chart and convey the key insights found within that chart.Our neural model is developed by extending the state-of-the-art model for the data-to-text generation task, which utilizes a transformerbased encoder-decoder architecture.We found that our approach outperforms the base model on a content selection metric by a wide margin (55.42% vs. 8.49%) and generates more informative, concise, and coherent summaries.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Challenges in Data-to-Document Generation
Wiseman, S., Shieber, S., & Rush, A. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1239 · Cited by 524
ToTTo: A Controlled Table-To-Text Generation Dataset
Parikh, A., Wang, X., Gehrmann, S., Faruqui, M., Dhingra, B., Yang, D., & Das, D. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.89 · Cited by 252
ToTTo: A Controlled Table-To-Text Generation Dataset
Parikh, A. P., Wang, X., Gehrmann, S., Faruqui, M., Dhingra, B., Yang, D., & Das, D. (2020) · arXiv · doi:10.48550/arxiv.2004.14373 · Cited by 252
Evaluating a Tool for Improving Accessibility to Charts and Graphs
Ferres, L., Lindgaard, G., Sumegi, L., & Tsuji, B. (2013) · ACM Transactions on Computer-Human Interaction · doi:10.1145/2533682.2533683 · Cited by 67
Cited by
Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Content
Lundgard, A., & Satyanarayan, A. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114770 · Cited by 155
Jung, C., Mehta, S., Kulkarni, A., Zhao, Y., & Kim, Y.-S. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2021.3114846 · Cited by 91
SciCap: Generating Captions for Scientific Figures
Hsu, T.-Y., Giles, C. L., & Huang, T.-H. (2021) · Findings of the Association for Computational Linguistics: EMNLP 2021 · doi:10.18653/v1/2021.findings-emnlp.277 · Cited by 59
DATATALES: Investigating the use of Large Language Models for Authoring Data-Driven Articles
Sultanum, N., & Srinivasan, A. (2023) · 2023 IEEE Visualization and Visual Analytics (VIS) · doi:10.1109/vis54172.2023.00055 · Cited by 52
InkSight: Leveraging Sketch Interaction for Documenting Chart Findings in Computational Notebooks
Lin, Y., Li, H., Yang, L., Wu, A., & Qu, H. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3327170 · Cited by 40
Metadata
- Authors
- Obeid, J., & Hoque, E.
- Venue
- Proceedings of the 13th International Conference on Natural Language Generation
- Published
- 2020
- Pages
- 138-147
- OpenAlex
- W3094916564
- Cited by
- 91
- References
- 5
- FWCI
- 3.81
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Chart-to-Text: Generating Natural Language Descriptions for Charts by Adapting the Transformer Model. https://app.cochat.ai/papers/10.18653/v1/2020.inlg-1.20
- The paper
- Obeid, J., & Hoque, E. (2020). Chart-to-Text: Generating Natural Language Descriptions for Charts by Adapting the Transformer Model. Proceedings of the 13th International Conference on Natural Language Generation. https://doi.org/10.18653/v1/2020.inlg-1.20
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.