CoChat

AIDE: an automatic image description engine for review imagery

Sreedhar, Rachana, Tan, Nicole, Zhang, Jingyue, Jin, Kim, Gregson, Spencer, Moreta-Feliz, Eli, Samudrala, Niveditha, Sadalgi, Shrenik · 2022 · Proceedings of the 19th International Web for All Conference

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.

Abstract

Review imagery is crucial for helping online shoppers validate product information and garner context from unbiased reviewers. However, blind or low vision (BLV) shoppers, who routinely use screen readers, report challenges accessing review imagery, citing minimal to generic alt-text that often accompany these images. Contextual alt-text impacts the quality of a BLV shopper's browsing experience; our initial surveys additionally reveal that shoppers want product color and product features in alt-text descriptions for review imagery. We present AIDE, an Automatic Image Description Engine for review imagery, which leverages object detection and keyword extraction to automatically generate alt-text containing context-specific product feature information. Evaluative studies indicate that AIDE promotes accessibility by fostering a more inclusive shopping environment, increases the feeling of independence, and encourages online retail engagement.

Overview

Integrity signals

Registry

Crossref · 10.1145/3493612.3520465

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 6 references

Research works printed but not linked: 5

  1. Jason P. C. Chiu and Eric Nichols . 2016 . Named Entity Recognition with Bidirectional LSTM-CNNs . arXiv:1511.08308 [cs] (July 2016). http://arxiv.org/abs/1511.08308 arXiv: 1511.08308. Jason P. C. Chiu and Eric Nichols. 2016. Named Entity Recognition with Bidirectional LSTM-CNNs. arXiv:1511.08308 [cs] (July 2016). http://arxiv.org/abs/1511.08308 arXiv: 1511.08308. · arXiv
  2. Xiaotian Han , Jianwei Yang , Houdong Hu , Lei Zhang , Jianfeng Gao , and Pengchuan Zhang . 2021. Image Scene Graph Generation (SGG) Benchmark. arXiv:2107.12604 [cs] (July 2021 ). http://arxiv.org/abs/2107.12604 arXiv: 2107.12604. Xiaotian Han, Jianwei Yang, Houdong Hu, Lei Zhang, Jianfeng Gao, and Pengchuan Zhang. 2021. Image Scene Graph Generation (SGG) Benchmark. arXiv:2107.12604 [cs] (July 2021). http://arxiv.org/abs/2107.12604 arXiv: 2107.12604. · arXiv
  3. Xiujun Li , Xi Yin , Chunyuan Li , Pengchuan Zhang , Xiaowei Hu , Lei Zhang , Lijuan Wang , Houdong Hu , Li Dong , Furu Wei , Yejin Choi , and Jianfeng Gao . 2020 . Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks. arXiv:2004.06165 [cs] (July 2020). http://arxiv.org/abs/2004.06165 arXiv: 2004.06165. Xiujun Li, Xi Yin, Chunyuan Li, Pengchuan Zhang, Xiaowei Hu, Lei Zhang, Lijuan Wang, Houdong Hu, Li Dong, Furu Wei, Yejin Choi, and Jianfeng Gao. 2020. Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks. arXiv:2004.06165 [cs] (July 2020). http://arxiv.org/abs/2004.06165 arXiv: 2004.06165. · arXiv
  4. Xuezhe Ma and Eduard Hovy . 2016. End-to-end Sequence Labeling via Bidirectional LSTM-CNNs-CRF. arXiv:1603.01354 [cs, stat] (May 2016 ). http://arxiv.org/abs/1603.01354 arXiv: 1603.01354. Xuezhe Ma and Eduard Hovy. 2016. End-to-end Sequence Labeling via Bidirectional LSTM-CNNs-CRF. arXiv:1603.01354 [cs, stat] (May 2016). http://arxiv.org/abs/1603.01354 arXiv: 1603.01354. · arXiv
  5. Pengchuan Zhang , Xiujun Li , Xiaowei Hu , Jianwei Yang , Lei Zhang , Lijuan Wang , Yejin Choi , and Jianfeng Gao . 2021. VinVL: Revisiting Visual Representations in Vision-Language Models. arXiv:2101.00529 [cs] (March 2021 ). http://arxiv.org/abs/2101.00529 arXiv: 2101.00529. Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, and Jianfeng Gao. 2021. VinVL: Revisiting Visual Representations in Vision-Language Models. arXiv:2101.00529 [cs] (March 2021). http://arxiv.org/abs/2101.00529 arXiv: 2101.00529. · arXiv

Cited by

See all 1

Metadata

Authors
Sreedhar, R., Tan, N., Zhang, J., Jin, K., Gregson, S., Moreta-Feliz, E., Samudrala, N., & Sadalgi, S.
Affiliations
Wayfair Next
Venue
Proceedings of the 19th International Web for All Conference
Publisher
ACM
Published
2022-04-25
Pages
1-3
OpenAlex
W4224990175
Cited by
1
References
6
Citations by year
2024: 1
FWCI
0.36
Type
conference paper
Language
en
Open access
closed
Locations
International Web for All Conference (W4A) (publishedVersion)
Topics
  • Social Sciences › Human Factors and Ergonomics › Digital Accessibility for Disabilities
  • Health Sciences › Health Professions › Occupational Therapy › Assistive Technology in Communication and Mobility
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Image Retrieval and Classification Techniques
Keywords
blind and visually impaired users, screen readers, alt text, object detection, keyword extraction

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: AIDE: an automatic image description engine for review imagery. https://app.cochat.ai/papers/10.1145/3493612.3520465
The paper
Sreedhar, R., Tan, N., Zhang, J., Jin, K., Gregson, S., Moreta-Feliz, E., Samudrala, N., & Sadalgi, S. (2022). AIDE: an automatic image description engine for review imagery. Proceedings of the 19th International Web for All Conference. https://doi.org/10.1145/3493612.3520465

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.