Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and Symbols
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Despite the central importance of research papers to scientific progress, they can be difficult to read. Comprehension is often stymied when the information needed to understand a passage resides somewhere else—in another section, or in another paper. In this work, we envision how interfaces can bring definitions of technical terms and symbols to readers when and where they need them most. We introduce ScholarPhi, an augmented reading interface with four novel features: (1) tooltips that surface position-sensitive definitions from elsewhere in a paper, (2) a filter over the paper that “declutters” it to reveal how the term or symbol is used across the paper, (3) automatic equation diagrams that expose multiple definitions in parallel, and (4) an automatically generated glossary of important terms and symbols. A usability study showed that the tool helps researchers of all experience levels read papers. Furthermore, researchers were eager to have ScholarPhi’s definitions available to support their everyday reading.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
lmerTest Package: Tests in Linear Mixed Effects Models
Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017) · Journal of Statistical Software · doi:10.18637/jss.v082.i13 · Cited by 24,346
Understanding the Effect of Accuracy on Trust in Machine Learning Models
Yin, M., Wortman Vaughan, J., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300509 · Cited by 527 · cited 1×
“Researchers in human-computer interaction have explored how users interact with imperfect AI algorithms [48, 105].”
BackgroundS2ORC: The Semantic Scholar Open Research Corpus
Lo, K., Wang, L. L., Neumann, M., Kinney, R., & Weld, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.447 · Cited by 457
Self-citationRobotReviewer: evaluation of a system for automatically assessing bias in clinical trials
Marshall, I. J., Kuiper, J., & Wallace, B. C. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv044 · Cited by 317 · cited 1×
“Experimental tools have been built that augment papers with additional information about cited papers [78], bias in study design [63], and links to external learning resources [40, 59].”
BackgroundElectronic journals and changes in scholarly article seeking and reading patterns
Tenopir, C., King, D. W., Edwards, S., & Wu, L. (2009) · Aslib Proceedings · doi:10.1108/00012530910932267 · Cited by 314 · cited 2×
“tutes a major part of a researcher’s everyday work. Senior researchers, such as faculty members, spend over one hundred hours a year reading the literature, consuming over one hundred papers annually [97]. And despite the formidable background knowledge that a researcher gains over the course of their career, they wil…”
BackgroundPhysicists Reading Physics: Schema-Laden Purposes and Purpose-Laden Schema
BAZERMAN, C. (1985) · Written Communication · doi:10.1177/0741088385002001001 · Cited by 279
Kocielnik, R., Amershi, S., & Bennett, P. N. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300641 · Cited by 277
Expert and Novice Approaches to Reading Mathematical Proofs
Inglis, M., & Alcock, L. (2012) · Journal for Research in Mathematics Education · doi:10.5951/jresematheduc.43.4.0358 · Cited by 212
How Mathematicians Determine if an Argument Is a Valid Proof
Weber, K. (2008) · Journal for Research in Mathematics Education · doi:10.5951/jresematheduc.39.4.0431 · Cited by 170
TLDR: Extreme Summarization of Scientific Documents
Cachola, I., Lo, K., Cohan, A., & Weld, D. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.428 · Cited by 169 · cited 1×
“angers [26], and crowds [39] to annotate and discuss passages of papers. Other approaches to saving the scientist time include tools to support literature search (e.g., [77, 80, 109]), summarize text [10, 87], or rewrite passages in simpler language [46]. 2.3.2 Links within Papers. Reading interfaces can also assist r…”
BackgroundInfluentialSelf-citationLemonAid: selection-based crowdsourced contextual help for web applications
Chilana, P. K., Ko, A. J., & Wobbrock, J. O. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208620 · Cited by 79 · cited 1×
“e a permanent fixture on the site [68]. Recent proceedings of human-computer interaction conferences have introduced prototypes that allow readers to answer their questions about how to use web pages [14], the meaning of cryptic programming syntax [30], hard-to-visualize quantities [37], and unfamiliar words from a se…”
BackgroundInfluentialChanges in Scholarly Reading in Finland Over a Decade: Influences of E-Journals and Social Media
Tenopir, C., Late, E., Talja, S., & Christian, L. (2019) · Libri · doi:10.1515/libri-2018-0120 · Cited by 8 · cited 1×
“difficulty of reading a specific paper [8]. Reading is made all the more challenging by the fact that scholars increasingly read selectively, looking for specific information by skimming and scanning [33,63,90]. ∗Also with University of Washington. deÞnition nonce word (the symbol "k") hyperlink to deÞnition…”
Background
Cited by
Revise and Resubmit: An Intertextual Model of Text-based Collaboration in Peer Review
Kuznetsov, I., Buchmann, J., Eichler, M., & Gurevych, I. (2022) · Computational Linguistics · doi:10.1162/coli_a_00455 · Cited by 17
SciA11y: Converting Scientific Papers to Accessible HTML
Wang, L. L., Cachola, I., Bragg, J., Cheng, E. Y.-Y., Haupt, C., Latzke, M., Kuehl, B., van Zuylen, M. N., Wagner, L., & Weld, D. (2021) · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3441852.3476545 · Cited by 14
Self-citationWang, X., Huey, S. L., Sheng, R., Mehta, S., & Wang, F. (2025) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.1002/cl2.70073 · Cited by 13
LLMs as Research Tools: A Large Scale Survey of Researchers' Usage and Perceptions
Liao, Z., Antoniak, M., Cheong, I., Cheng, E. Y.-Y., Lee, A.-H., Lo, K., Chang, J. C., & Zhang, A. X. (2024) · arXiv · doi:10.48550/arxiv.2411.05025 · Cited by 7
Self-citationContextualized Programming Language Documentation
Potter, H., Madadi, A., Just, R., & Omar, C. (2022) · Proceedings of the 2022 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software · doi:10.1145/3563835.3567654 · Cited by 4
“One such work is ScholarPhi [8].”
Method
Metadata
- Authors
- Head, A., Lo, K., Kang, D., Fok, R., Skjonsberg, S., Weld, D. S., & Hearst, M. A.
- Venue
- Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2021-05-06
- Pages
- 1-18
- OpenAlex
- W3091542069
- Cited by
- 88
- References
- 12
- FWCI
- 5.28
- Type
- conference paper
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.