Rescribe: Authoring and Automatically Editing Audio Descriptions
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Audio descriptions make videos accessible to those who cannot see them by describing visual content in audio. Producing audio descriptions is challenging due to the synchronous nature of the audio description that must fit into gaps of other video content. An experienced audio description author will produce content that fits narration necessary to understand, enjoy, or experience the video content into the time available. This can be especially tricky for novices to do well. In this paper, we introduce a tool, Rescribe, that helps authors create and refine their audio descriptions. Using Rescribe, authors first create a draft of all the content they would like to include in the audio description. Rescribe then uses a dynamic programming approach to optimize between the length of the audio description, available automatic shortening approaches, and source track lengthening approaches. Authors can iteratively visualize and refine the audio descriptions produced by Rescribe, working in concert with the tool. We evaluate the effectiveness of Rescribe through interviews with blind and visually impaired audio description users who give feedback on Rescribe results. In addition, we invite novice users to create audio descriptions with Rescribe and another tool, finding that users produce audio descriptions with fewer placement errors using Rescribe.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Soylent: a word processor with a crowd inside
Bernstein, M. S., Little, G., Miller, R. C., Hartmann, B., Ackerman, M. S., Karger, D. R., Crowell, D., & Panovich, K. (2010) · Proceedings of the 23nd annual ACM symposium on User interface software and technology · doi:10.1145/1866029.1866078 · Cited by 686 · cited 1×
“sentence compression (shortening sentences) [16], which are less commonly used in existing tools for writing support. While prior work reveals people can collaboratively perform paragraph shortening [7] and summarization [63, 58] tasks with success, automatic techniques still achieve varying results, especially with r…”
BackgroundText-based Editing of Talking-head Video
Fried, O., Tewari, A., Zollhöfer, M., Finkelstein, A., Shechtman, E., Goldman, D. B., Genova, K., Jin, Z., Theobalt, C., & Agrawala, M. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3323028 · Cited by 270
Understanding Blind People's Experiences with Computer-Generated Captions of Social Media Images
MacLeod, H., Bennett, C. L., Morris, M. R., & Cutrell, E. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025814 · Cited by 200 · cited 1×
“We investigated using automated methods (e.g., dense image and video captioning [26, 29], scene description [51, 33, 21]) to produce descriptions for videos (or keyframes), but current tools provide results that are too general or inaccurate to be useful.”
MethodStangl, A., Morris, M. R., & Gurari, D. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376404 · Cited by 139
SceneSkim: Searching and Browsing Movies Using Synchronized Captions, Scripts and Plot Summaries
Pavel, A., Goldman, D. B., Hartmann, B., & Agrawala, M. (2015) · Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology · doi:10.1145/2807442.2807502 · Cited by 67 · cited 1×
“d silence [14]. We also align words from the source video transcript (e.g., from existing captions or rev.ai) to the original audio, by first grouping together continuous captions following prior work [40], then using Gentle [38] alignment which finds an alignment between the phonemes in the words of the transcript and…”
MethodSelf-citation
Cited by
Making Mobile Augmented Reality Applications Accessible
Herskovitz, J., Wu, J., White, S., Pavel, A., Reyes, G., Guo, A., & Bigham, J. P. (2020) · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3373625.3417006 · Cited by 46
Self-citationCodeA11y: Making AI Coding Assistants Useful for Accessible Web Development
Mowar, P., Peng, Y.-H., Wu, J., Steinfeld, A., & Bigham, J. P. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713335 · Cited by 31
Self-citationToward supporting quality alt text in computing publications
Williams, C., de Greef, L., Harris, E., Findlater, L., Pavel, A., & Bennett, C. (2022) · Proceedings of the 19th International Web for All Conference · doi:10.1145/3493612.3520449 · Cited by 26
Self-citationSurfacing Variations to Calibrate Perceived Reliability of MLLM-generated Image Descriptions
Chen, M., Iyer, A., & Pavel, A. (2025) · Proceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3663547.3746393 · Cited by 6
Self-citation
Metadata
- Authors
- Pavel, A., Reyes, G., & Bigham, J. P.
- Venue
- Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology
- Publisher
- ACM
- Published
- 2020-10-20
- Pages
- 747-759
- OpenAlex
- W3094385957
- Cited by
- 72
- References
- 5
- FWCI
- 55.88
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Rescribe: Authoring and Automatically Editing Audio Descriptions. https://app.cochat.ai/papers/10.1145/3379337.3415864
- The paper
- Pavel, A., Reyes, G., & Bigham, J. P. (2020). Rescribe: Authoring and Automatically Editing Audio Descriptions. Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. https://doi.org/10.1145/3379337.3415864
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.