Rapid understanding of scientific paper collections: Integrating statistics, text analytics, and visualization
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Keeping up with rapidly growing research fields, especially when there are multiple interdisciplinary sources, requires substantial effort for researchers, program managers, or venture capital investors. Current theories and tools are directed at finding a paper or website, not gaining an understanding of the key papers, authors, controversies, and hypotheses. This report presents an effort to integrate statistics, text analytics, and visualization in a multiple coordinated window environment that supports exploration. Our prototype system, A ction S cience E xplorer (ASE), provides an environment for demonstrating principles of coordination and conducting iterative usability tests of them with interested and knowledgeable users. We developed an understanding of the value of reference management, statistics, citation text extraction, natural language summarization for single and multiple documents, filters to interactively select key papers, and network visualization to see citation patterns and identify clusters. A three‐phase usability study guided our revisions to ASE and led us to improve the testing methods.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Searching for intellectual turning points: progressive knowledge domain visualization
Chen, C. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0307513100 · Cited by 2,791
Exploratory search: from finding to understanding
Marchionini, G. (2006) · Communications of the ACM · doi:10.1145/1121949.1121979 · Cited by 1,506
Information seeking in electronic environments
(1996) · Choice Reviews Online · doi:10.5860/choice.33-3366 · Cited by 1,487
Hearst, M. A. (2009) · doi:10.1017/cbo9781139644082 · Cited by 797
Automatic classification of citation function
Teufel, S., Siddharthan, A., & Tidhar, D. (2006) · Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing - EMNLP '06 · doi:10.3115/1610075.1610091 · Cited by 437
Cited by
Cheng, K.-H., Liang, J.-C., & Tsai, C.-C. (2015) · The Internet and Higher Education · doi:10.1016/j.iheduc.2015.02.001 · Cited by 174
Alwood, J. S., Ronca, A. E., Mains, R. C., Shelhamer, M. J., Smith, J. D., & Goodwin, T. J. (2017) · npj Microgravity · doi:10.1038/s41526-016-0002-8 · Cited by 29
Fabbri, S., Hernandes, E., Di Thommazo, A., Belgamo, A., Zamboni, A., & Silva, C. (2013) · Lecture Notes in Business Information Processing · doi:10.1007/978-3-642-40654-6_15 · Cited by 20
Metadata
- Authors
- Dunne, C., Shneiderman, B., Gove, R., Klavans, J., & Dorr, B.
- Venue
- Journal of the American Society for Information Science and Technology
- Publisher
- Wiley
- Published
- 2012-11-29
- Volume
- 63
- Issue
- 12
- Pages
- 2351-2369
- ISSN
- 1532-2882 (ISSN-L)
- 1532-2890
- OpenAlex
- W2132068911
- Cited by
- 101
- References
- 5
- FWCI
- 12.79
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.