Opal: Multimodal Image Generation for News Illustration
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Advances in multimodal AI have presented people with powerful ways to create images from text. Recent work has shown that text-to-image generations are able to represent a broad range of subjects and artistic styles. However, finding the right visual language for text prompts is difficult. In this paper, we address this challenge with Opal, a system that produces text-to-image generations for news illustration. Given an article, Opal guides users through a structured search for visual concepts and provides a pipeline allowing users to generate illustrations based on an article’s tone, keywords, and related artistic styles. Our evaluation shows that Opal efficiently generates diverse sets of news illustrations, visual assets, and concept ideas. Users with Opal generated two times more usable results than users without. We discuss how structured exploration can help users better understand the capabilities of human AI co-creative systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“As units, cells can then be assembled together into generation inputs (e.g., sentences into an essay and requirements into a prompt) which allows users to quickly assemble input variations [6,59] or to mix-and-match the variants [101,111].”
From Cells, Generators, and Lenses: Design Framework for Object-Oriented Interaction with Large Language Models (2023) · cites this paper as [59]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372 · cited 1×
“The rise of transformer models [6] and its success in few-shot learning has led to the rise of a new form of interaction with AI models known as prompt engineering.”
BackgroundLearning Transferable Visual Models From Natural Language Supervision
Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al. (2021) · arXiv · doi:10.48550/arxiv.2103.00020 · Cited by 15,293 · cited 1×
“[31] Many of the earliest open-source text-to-image generative frameworks to gain traction used CLIP in a discriminator like fashion, using it in conjunction with a host of generative models from BigGan to VQGAN.”
MethodKaugeranna, R., Kaugeranna, E., & Aion, (. S. 4. 6. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.giscience.2023.43 · Cited by 13,690
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N., & Gurevych, I. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1410 · Cited by 12,778
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr42600.2020.00813 · Cited by 6,332
Analyzing and Improving the Image Quality of StyleGAN
Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., & Aila, T. (2019) · arXiv · doi:10.48550/arxiv.1912.04958 · Cited by 6,332
Semantic Image Synthesis With Spatially-Adaptive Normalization
Park, T., Liu, M.-Y., Wang, T.-C., & Zhu, J.-Y. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00244 · Cited by 2,974 · cited 1×
“[31] For generative design and AI, style has long been a popular method of steering and interacting with generative art tools.”
MethodA Neural Algorithm of Artistic Style
Gatys, L., Ecker, A., & Bethge, M. (2016) · Journal of Vision · doi:10.1167/16.12.326 · Cited by 2,612
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
Saharia, C., Chan, W., Saxena, S., Li, L., Whang, J., Denton, E., Ghasemipour, S. K. S., Ayan, B. K., Mahdavi, S. S., Lopes, R. G., et al. (2022) · arXiv · doi:10.48550/arxiv.2205.11487 · Cited by 2,528 · cited 3×
“For text-to-image generation, we used the checkpoint and configuration of VQGAN+CLIP that was pretrained on Imagenet with a codebook size of 16384 [37].”
BackgroundTaming Transformers for High-Resolution Image Synthesis
Esser, P., Rombach, R., & Ommer, B. (2020) · arXiv · doi:10.48550/arxiv.2012.09841 · Cited by 2,514
Taming Transformers for High-Resolution Image Synthesis
Esser, P., Rombach, R., & Ommer, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01268 · Cited by 2,514 · cited 1×
“[2, 12, 13, 17] Newer methods such as diffusion models have also increased output quality.”
MethodHierarchical Text-Conditional Image Generation with CLIP Latents
Ramesh, A., Dhariwal, P., Nichol, A., Chu, C., & Chen, M. (2022) · arXiv · doi:10.48550/arxiv.2204.06125 · Cited by 2,511 · cited 1×
“[15, 19, 36, 37] DALL·E 2 [42] showed by conditioning on a CLIP text prior, generating CLIP image representations, and decoding those representations either autoregressively or with difusion, DALL·E 2 could create a text-to-image generator with novel functionalities like image remixing, inpainting, and interpolation.”
MethodPrefix-Tuning: Optimizing Continuous Prompts for Generation
Li, X. L., & Liang, P. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.353 · Cited by 2,473
AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial NetworksPreprint
Xu, T., Zhang, P.-C., Huang, Q., Zhang, H., Gan, Z., Huang, X., & He, X.-D. (2017) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.48550/arxiv.1711.10485 · Cited by 2,038
AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networks
Xu, T., Zhang, P., Huang, Q., Zhang, H., Gan, Z., Huang, X., & He, X. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00143 · Cited by 1,923
Making Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.295 · Cited by 1,380
Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm
Reynolds, L., & McDonell, K. (2021) · Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411763.3451760 · Cited by 952 · cited 1×
“[7, 45] At present, it is currently unknown how prompt engineering compares to fine-tuning and which is better.”
BackgroundMirrorGAN: Learning Text-To-Image Generation by Redescription
Qiao, T., Zhang, J., Xu, D., & Tao, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00160 · Cited by 644 · cited 1×
“As tools moved away from statistical-based techniques to GANs, a number of text-to-image architectures [39, 40, 52, 53] were proposed.”
MethodDesign Guidelines for Prompt Engineering Text-to-Image Generative Models
Liu, V., & Chilton, L. B. (2021) · arXiv · doi:10.48550/arxiv.2109.06977 · Cited by 635
Self-citationWu, T., Terry, M., & Cai, C. J. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517582 · Cited by 483
Cupchik, G. C., Vartanian, O., Crawley, A., & Mikulis, D. J. (2009) · Brain and Cognition · doi:10.1016/j.bandc.2009.01.003 · Cited by 421
WordsEye: an automatic text-to-scene conversion system
Coyne, B., & Sproat, R. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383316 · Cited by 377
TediGAN: Text-Guided Diverse Face Image Generation and Manipulation
Xia, W., Yang, Y., Xue, J.-H., & Wu, B. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.00229 · Cited by 376 · cited 1×
“As tools moved away from statistical-based techniques to GANs, a number of text-to-image architectures [39, 40, 52, 53] were proposed.”
MethodScaling Autoregressive Models for Content-Rich Text-to-Image Generation
Yu, J., Xu, Y., Koh, J. Y., Luong, T., Baid, G., Wang, Z., Vasudevan, V., Ku, A., Yang, Y., Ayan, B. K., et al. (2022) · arXiv · doi:10.48550/arxiv.2206.10789 · Cited by 371
VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidance
Crowson, K., Biderman, S., Kornis, D., Stander, D., Hallahan, E., Castricato, L., & Raff, E. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-19836-6_6 · Cited by 279
PromptChainer: Chaining Large Language Model Prompts through Visual Programming
Wu, T., Jiang, E., Donsbach, A., Gray, J., Molina, A., Terry, M., & Cai, C. J. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3519729 · Cited by 198
DALL-EVAL: Probing the Reasoning Skills and Social Biases of Text-to-Image Generation Models
Cho, J., Zala, A., & Bansal, M. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.00283 · Cited by 175
PromptMaker: Prompt-based Prototyping with Large Language Models
Jiang, E., Olson, K., Toh, E., Molina, A., Donsbach, A., Terry, M., & Cai, C. J. (2022) · CHI Conference on Human Factors in Computing Systems Extended Abstracts · doi:10.1145/3491101.3503564 · Cited by 157 · cited 1×
“[29] was one of the frst to show the utility of prompts embedded within systems by helping industry professionals conduct prompt-based prototyping of machine learning.”
BackgroundMetaphoria: An Algorithmic Companion for Metaphor Creation
Gero, K. I., & Chilton, L. B. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300526 · Cited by 146 · cited 1×
“[8] and [22] both investigated how computational models explored the connections of abstract concept to abstract concept via symbols to implement metaphor generation in the vein of creativity support.”
BackgroundSelf-citationDream Lens: Exploration and Visualization of Large-Scale Generative Design Datasets
Matejka, J., Glueck, M., Bradner, E., Hashemi, A., Grossman, T., & Fitzmaurice, G. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173943 · Cited by 144
DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generative TransformersPreprint
Cho, J., Zala, A., & Bansal, M. (2022) · arXiv.org · doi:10.48550/arxiv.2202.04053 · Cited by 136
Making Pre-trained Language Models Better Few-shot Learners
Gao, T., Fisch, A., & Chen, D. (2020) · arXiv · doi:10.48550/arxiv.2012.15723 · Cited by 124
Attribit: content creation with semantic attributes
Chaudhuri, S., Kalogerakis, E., Giguere, S., & Funkhouser, T. (2013) · Proceedings of the 26th annual ACM symposium on User interface software and technology · doi:10.1145/2501988.2502008 · Cited by 123
Mental Models of AI Agents in a Cooperative Game Setting
Gero, K. I., Ashktorab, Z., Dugan, C., Pan, Q., Johnson, J., Geyer, W., Ruiz, M., Miller, S., Millen, D. R., Campbell, M., et al. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376316 · Cited by 121 · cited 1×
“[21], who mention that it is important for users interacting with AI to develop a mental concept of what kind knowledge an AI is capable of displaying.”
BackgroundWhere to Hide a Stolen Elephant: Leaps in Creative Writing with Multimodal Machine Intelligence
Singh, N., Bernal, G., Savchenko, D., & Glassman, E. L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3511599 · Cited by 119 · cited 1×
“[36] Recent momentum within multimodal representation learning has driven more people to create and open-source multimodal frameworks and systems.”
BackgroundStyle follows content: On the microgenesis of art perception
Augustin, M., Leder, H., Hutzler, F., & Carbon, C. (2008) · Acta Psychologica · doi:10.1016/j.actpsy.2007.11.006 · Cited by 113
ChatPainter: Improving Text to Image Generation using Dialogue
Sharma, S., Suhubdy, D., Michalski, V., Kahou, S. E., & Bengio, Y. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.08216 · Cited by 73
MERMAID: Metaphor Generation with Symbolism and Discriminative Decoding
Chakrabarty, T., Zhang, X., Muresan, S., & Peng, N. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/2021.naacl-main.336 · Cited by 43
Sceneseer:3d scene design with natural language.
Chang, A. X., Eric, M., Savva, M., & Manning, C. D. (2017) · arXiv · doi:10.48550/arxiv.1703.00050 · Cited by 38
TediGAN: Text-Guided Diverse Face Image Generation and ManipulationPreprint
Xia, W., Yang, Y., Xue, J., & Wu, B. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.03308 · Cited by 31
Shimizu, E., Fisher, M., Paris, S., McCann, J., & Fatahalian, K. (2020) · Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3379337.3415866 · Cited by 22
Sparks: Inspiration for Science Writing using Language ModelsPreprint
Gero, K. I., Liu, V., & Chilton, L. B. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2110.07640 · Cited by 20
Self-citation
Research works printed but not linked: 14
- 2020. CHI ’20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu , HI, USA) . Association for Computing Machinery , New York, NY, USA . 2020. CHI ’20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA). Association for Computing Machinery, New York, NY, USA.
- Gunjan Aggarwal and Devi Parikh. 2020. Neuro-Symbolic Generative Art: A Preliminary Study. arxiv:2007.02171 [cs.AI] Gunjan Aggarwal and Devi Parikh. 2020. Neuro-Symbolic Generative Art: A Preliminary Study. arxiv:2007.02171 [cs.AI] · arXiv
- Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan Prafulla Dhariwal Arvind Neelakantan Pranav Shyam Girish Sastry Amanda Askell Sandhini Agarwal Ariel Herbert-Voss Gretchen Krueger Tom Henighan Rewon Child Aditya Ramesh Daniel M. Ziegler Jeffrey Wu Clemens Winter Christopher Hesse Mark Chen Eric Sigler Mateusz Litwin Scott Gray Benjamin Chess Jack Clark Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever and Dario Amodei. 2020. Language Models are Few-Shot Learners. https://doi.org/10.48550/ARXIV.2005.14165 · DOI · Paper page
- Alex Calderwood , Vivian Qiu , Katy Ilonka Gero , and Lydia B Chilton . 2018 . How Novelists Use Generative Language Models: An Exploratory User Study. In 23rd International Conference on Intelligent User Interfaces. ACM. Alex Calderwood, Vivian Qiu, Katy Ilonka Gero, and Lydia B Chilton. 2018. How Novelists Use Generative Language Models: An Exploratory User Study. In 23rd International Conference on Intelligent User Interfaces. ACM.
- Bob Coyne and Richard Sproat. 2022. WordsEye: an automatic text-to-scene conversion system. https://doi.org/10.1145/383259.383316 · DOI · Paper page
- Songwei Ge and Devi Parikh. 2021. Visual Conceptual Blending with Large-scale Language and Vision Models. arxiv:2106.14127 [cs.CL] Songwei Ge and Devi Parikh. 2021. Visual Conceptual Blending with Large-scale Language and Vision Models. arxiv:2106.14127 [cs.CL] · arXiv
- Hideaki Kawabata and Semir Zeki . 2004. Neural correlates of beauty.Journal of neurophysiology 91 4 ( 2004 ), 1699–705. Hideaki Kawabata and Semir Zeki. 2004. Neural correlates of beauty.Journal of neurophysiology 91 4 (2004), 1699–705.
- Vivian Liu and Lydia Chilton. [n.d.]. Neurosymbolic generation of 3D animal shapes through... - ceur-ws.org. http://ceur-ws.org/Vol-2903/IUI21WS-HAIGEN-8.pdf Vivian Liu and Lydia Chilton. [n.d.]. Neurosymbolic generation of 3D animal shapes through... - ceur-ws.org. http://ceur-ws.org/Vol-2903/IUI21WS-HAIGEN-8.pdf
- Tingting Qiao , Jing Zhang , Duanqing Xu , and Dacheng Tao . 2019. Learn , Imagine and Create: Text-to-Image Generation from Prior Knowledge . In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Eds.). Vol. 32. Curran Associates , Inc .https://proceedings.neurips.cc/paper/ 2019 /file/d18f655c3fce66ca401d5f38b48c89af-Paper.pdf Tingting Qiao, Jing Zhang, Duanqing Xu, and Dacheng Tao. 2019. Learn, Imagine and Create: Text-to-Image Generation from Prior Knowledge. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Eds.). Vol. 32. Curran Associates, Inc.https://proceedings.neurips.cc/paper/2019/file/d18f655c3fce66ca401d5f38b48c89af-Paper.pdf
- Tingting Qiao Jing Zhang Duanqing Xu and Dacheng Tao. 2019. MirrorGAN: Learning Text-to-image Generation by Redescription. https://doi.org/10.48550/ARXIV.1903.05854 · DOI · Paper page
- Aditya Ramesh Prafulla Dhariwal Alex Nichol Casey Chu and Mark Chen. 2022. Hierarchical Text-Conditional Image Generation with CLIP Latents. https://doi.org/10.48550/ARXIV.2204.06125 · DOI · Paper page
- Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. https://doi.org/10.48550/ARXIV.1908.10084 · DOI · Paper page
- Shikhar Sharma Dendi Suhubdy Vincent Michalski Samira Ebrahimi Kahou and Yoshua Bengio. 2018. ChatPainter: Improving Text to Image Generation using Dialogue. https://doi.org/10.48550/ARXIV.1802.08216 · arXiv · doi:10.48550/arxiv.1802.08216 · Paper page
- Jiahui Yu Yuanzhong Xu Jing Yu Koh Thang Luong Gunjan Baid Zirui Wang Vijay Vasudevan Alexander Ku Yinfei Yang Burcu Karagol Ayan Ben Hutchinson Wei Han Zarana Parekh Xin Li Han Zhang Jason Baldridge and Yonghui Wu. 2022. Scaling Autoregressive Models for Content-Rich Text-to-Image Generation. https://doi.org/10.48550/ARXIV.2206.10789 · DOI · Paper page
Cited by
Generative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606763 · Cited by 2,187
“We synthesize this research to suggest that large language models, though not sufficient by themselves, open up a new angle for creating believable agents when leveraged using the appropriate architecture.”
BackgroundGenerative Agents: Interactive Simulacra of Human Behavior
Park, J. S., O'Brien, J. C., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023) · arXiv · doi:10.48550/arxiv.2304.03442 · Cited by 2,173
Yenduri, G., Ramalingam, M., Selvi, G. C., Supriya, Y., Srivastava, G., Maddikunta, P. K. R., Raj, G. D., Jhaveri, R. H., Prabadevi, B., Wang, W., et al. (2024) · IEEE Access · doi:10.1109/access.2024.3389497 · Cited by 596
Liu, M., Zhang, L. J., & Biebricher, C. (2024) · Computers & Education · doi:10.1016/j.compedu.2023.104977 · Cited by 282
Brade, S., Wang, B., Sousa, M., Oore, S., & Grossman, T. (2023) · Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology · doi:10.1145/3586183.3606725 · Cited by 198
Metadata
- Authors
- Liu, V., Qiao, H., & Chilton, L.
- Affiliations
- Columbia University (US)
- University of Toronto (CA)
- Venue
- Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology
- Publisher
- ACM
- Published
- 2022-10-28
- Pages
- 1-17
- OpenAlex
- W4307475428
- Cited by
- 104
- References
- 30
- Citations by year
- 2026: 11 · 2025: 32 · 2024: 36 · 2023: 25
- FWCI
- 26.33
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Locations
- ACM Symposium on User Interface Software and Technology (UIST) (publishedVersion)
- arXiv (Cornell University) (submittedVersion, cc-by)
- arXiv (Cornell University) (cc-by)
- Funders
- National Science Foundation Graduate Research Fellowship Program (NSF DGE - 1644869)
- Topics
- Physical Sciences › Computer Science › Computer Graphics and Computer-Aided Design › Digital Media and Visual Art
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Multimodal Machine Learning Applications
- Keywords
- text-to-image generation, news illustration, multimodal AI, human-AI co-creation, artistic style, user guidance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.