Retrieval-enhanced adversarial training with dynamic memory-augmented attention for image paragraph captioning
The DOI matches its Crossref record; 26 of the 26 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In adversarial training, RAMP [307] takes retrieved captions as discriminator reference, and employs memory-augmented attention and copying mechanisms for better utilization of retrieved captions.”
From Retrieval-Augmented Generation for AI-Generated Content: A Survey (2024) · cites this paper as [307]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
Anderson, P., He, X., Buehler, C., Teney, D., Johnson, M., Gould, S., & Zhang, L. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00636 · Cited by 4,948
Deep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
CIDEr: Consensus-based image description evaluation
Vedantam, R., Zitnick, C. L., & Parikh, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7299087 · Cited by 4,845
Self-Critical Sequence Training for Image Captioning
Rennie, S. J., Marcheret, E., Mroueh, Y., Ross, J., & Goel, V. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.131 · Cited by 2,112
Meteor Universal: Language Specific Translation Evaluation for Any Target Language
Denkowski, M., & Lavie, A. (2014) · Proceedings of the Ninth Workshop on Statistical Machine Translation · doi:10.3115/v1/w14-3348 · Cited by 1,952
Image Captioning with Semantic Attention
You, Q., Jin, H., Wang, Z., Fang, C., & Luo, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.503 · Cited by 1,803
Knowing When to Look: Adaptive Attention via a Visual Sentinel for Image Captioning
Lu, J., Xiong, C., Parikh, D., & Socher, R. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.345 · Cited by 1,670
DenseCap: Fully Convolutional Localization Networks for Dense Captioning
Johnson, J., Karpathy, A., & Fei-Fei, L. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.494 · Cited by 1,137
Srivastava, R. K., Greff, K., & Schmidhuber, J. (2015) · arXiv · doi:10.48550/arxiv.1505.00387 · Cited by 912
A Hierarchical Approach for Generating Descriptive Image Paragraphs
Krause, J., Johnson, J., Krishna, R., & Fei-Fei, L. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.356 · Cited by 364
Speaking the Same Language: Matching Machine to Human Captions by Adversarial Training
Shetty, R., Rohrbach, M., Hendricks, L. A., Fritz, M., & Schiele, B. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.445 · Cited by 222
Recurrent Topic-Transition GAN for Visual Paragraph Generation
Liang, X., Hu, Z., Zhang, H., Gan, C., & Xing, E. P. (2017) · 2017 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2017.364 · Cited by 205
Remote sensing image captioning via Variational Autoencoder and Reinforcement Learning
Shen, X., Liu, B., Zhou, Y. Z., Zhao, J., & Liu, M. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.105920 · Cited by 112
Diverse and Coherent Paragraph Generation from Images
Chatterjee, M., & Schwing, A. G. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01216-8_45 · Cited by 70
Training for Diversity in Image Paragraph Captioning
Melas-Kyriazi, L., Rush, A. M., & Han, G. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1084 · Cited by 70
Language-Agnostic Visual-Semantic Embeddings
Wehrmann, J., Lopes, M. A., Souza, D. M., & Barros, R. C. (2019) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2019.00590 · Cited by 54
Recurrent Attention Network with Reinforced Generator for Visual Dialog
Fan, H., Zhu, L., Yang, Y., & Wu, F. Q. (2020) · ACM Transactions on Multimedia Computing Communications and Applications · doi:10.1145/3390891 · Cited by 51
Curiosity-driven Reinforcement Learning for Diverse Visual Paragraph Generation
Luo, Y., Huang, Z. H., Zhang, Z., Wang, Z., Li, J., & Yang, Y. (2019) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3343031.3350961 · Cited by 44
Convolutional Auto-encoding of Sentence Topics for Image Paragraph Generation
Wang, J., Pan, Y., Yao, T., Tang, J., & Mei, T. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/132 · Cited by 40
Show and Tell More: Topic-Oriented Multi-Sentence Image Captioning
Mao, Y., Zhou, C., Wang, X., & Li, R. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/592 · Cited by 35
Look Deeper See Richer: Depth-aware Image Paragraph Captioning
Wang, Z., Luo, Y., Li, Y., Huang, Z. H., & Yin, H. (2018) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3240508.3240583 · Cited by 33
A Unified Generation-Retrieval Framework for Image Captioning
Xu, C., Zhao, W., Yang, M., Ao, X., Cheng, W., & Tian, J. (2019) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3357384.3358105 · Cited by 15
Self-citationInteractive Key-Value Memory-augmented Attention for Image Paragraph Captioning
Xu, C., Yu, L., Li, C., Ao, X., Yang, M., & Tian, J. (2020) · International Conference on Computational Linguistics · doi:10.18653/v1/2020.coling-main.279 · Cited by 14
Self-citationDomain-Specific Image Captioning
Mason, R., & Eugene Charniak, D. (2014) · Conference on Computational Natural Language Learning · doi:10.3115/v1/w14-1602 · Cited by 12
Research works printed but not linked: 4
- K. Xu, J. Ba, R. Kiros, K. Cho, A. Courville, R. Salakhudinov, R. Zemel, Y. Bengio, Show, attend and tell: Neural image caption generation with visual attention, in: International Conference on Machine Learning, 2015, pp. 2048–2057.
- Zha, 2019, Context-aware visual policy network for fine-grained image captioning, IEEE Trans. Pattern Anal. Mach. Intell.
- Che, 2019, Visual relationship embedding network for image paragraph generation, IEEE Trans. Multimed.
- Srivastava, 2014, Dropout: a simple way to prevent neural networks from overfitting, J. Mach. Learn. Res., 15, 1929
Cited by
Retrieval-Augmented Generation for AI-Generated Content: A Survey
Zhao, P., Zhang, H., Yu, Q., Wang, Z., Geng, Y., Fu, F., Yang, L., Zhang, W., Jiang, J., & Cui, B. (2024) · arXiv · doi:10.48550/arxiv.2402.19473 · Cited by 240
Metadata
- Authors
- Xu, C., Yang, M., Ao, X., Shen, Y., Xu, R., & Tian, J.
- Venue
- Knowledge-Based Systems
- Publisher
- Elsevier BV
- Published
- 2021-02
- Volume
- 214
- Pages
- 106730
- ISSN
- 0950-7051
- Cited by
- 21
- References
- 26
- Language
- en
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- Funders
- National Natural Science Foundation of China (61906185)
- Natural Science Foundation of Guangdong Province of China (2019A1515011705)
- Shenzhen Science and Technology Innovation Program, China (KQTD20190929172835662)
- Youth Innovation Promotion Association of CAS China, China (JCYJ20200109113441941)
- Shenzhen Basic Research Foundation, China
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.