CoChat

Are all literature citations equally important? Automatic citation strength estimation and its applications

Wan, Xiaojun, Liu, Fang · 2014 · Journal of the Association for Information Science and Technology
Cited by 66

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Abstract

Literature citation analysis plays a very important role in bibliometrics and scientometrics, such as the S cience C itation I ndex (SCI) impact factor, h‐index. Existing citation analysis methods assume that all citations in a paper are equally important, and they simply count the number of citations. Here we argue that the citations in a paper are not equally important and some citations are more important than the others. We use a strength value to assess the importance of each citation and propose to use the regression method with a few useful features for automatically estimating the strength value of each citation. Evaluation results on a manually labeled data set in the computer science field show that the estimated values can achieve good correlation with human‐labeled values. We further apply the estimated citation strength values for evaluating paper influence and author influence, and the preliminary evaluation results demonstrate the usefulness of the citation strength values.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1002/asi.23083

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 4 references

Research works printed but not linked: 30

  1. Abu‐Jbara A. &Radev D.(2011).Coherent citation‐based summarization of scientific papers. InProceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies(Vol. 1 pp.500–509).
  2. Abu‐Jbara A. &Radev D.(2012).Reference scope identification in citing sentences. InProceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies(pp.80–90). Association for Computational Linguistics.
  3. 10.1007/s10791-009-9108-x · DOI
  4. Athar A. &Teufel S.(2012).Context‐enhanced citation sentiment detection. InProceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies(pp.597–601). Association for Computational Linguistics.
  5. 10.1145/1961189.1961199 · DOI · Paper page
  6. Cortez E. daSilva A.S. Gonçalves M.A. Mesquita F. &deMoura E.S.(2007).FLUX‐CIM: flexible unsupervised extraction of citation metadata. InProceedings of the 7th ACM/IEEE‐CS Joint Conference on Digital Libraries(pp.215–224). ACM. · DOI
  7. Councill I.G. Giles C.L. &Kan M.Y.(2008).ParsCit: An open‐source CRF reference string parsing package. InProceedings of LREC(Vol. 2008 pp.661–667). European Language Resources Association (ELRA).
  8. DeBellis N.(2009).Bibliometrics and citation analysis: from the science citation index to cybermetrics. Scarecrow Press.
  9. Dong C. &Schäfer U.(2011).Ensemble‐style self‐training on citation classification. InProceedings of the 5th international joint conference on natural language processing (IJCNLP2011)(pp.623–631).
  10. Egghe L., 1990, Introduction to Informetrics: Quantitative Methods in Library, Documentation and Information Science
  11. Eto M., 2007, Multivalued co‐citation measure based on semantic distance between co‐cited papers in a citing paper: A case study focused on enumeration of citations, Library and Information Science, 58, 49, 10.46895/lis.58.49 · DOI
  12. He Q. Pei J. Kifer D. Mitra P. &Giles L.(2010).Context‐aware citation recommendation. InProceedings of the 19th International Conference on World Wide Web(pp.421–430). ACM. · DOI · Paper page
  13. Jiang X. Sun X. &Zhuge H.(2012).Toward an effective and unbiased ranking of scientific literature through mutual reinforcement. InProceedings of the 21st ACM International Conference on Information and Knowledge Management(pp.714–723). ACM. · DOI
  14. 10.1002/asi.5090140103 · DOI · Paper page
  15. Mohammad S. Dorr B. Egan M. Hassan A. Muthukrishan P. Qazvinian V. &Zajic D.(2009).Using citations to generate surveys of scientific paradigms. InProceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics(pp.584–592). Association for Computational Linguistics. · DOI · Paper page
  16. 10.7152/acro.v11i1.12774 · DOI · Paper page
  17. 10.1016/j.joi.2012.08.006 · DOI
  18. Peng F. &McCallum A.(2004).Accurate information extraction from research papers using conditional random fields. HLT‐NAACL.
  19. 10.1016/j.joi.2010.03.006 · DOI
  20. Piao S. Ananiadou S. Tsuruoka Y. Sasaki Y. &McNaught J.(2007).Mining opinion polarity relations of citations. InInternational Workshop on Computational Semantics (IWCS)(pp.366–371).
  21. Pollman T., 2000, ALWD Citation Manual: A Professional System of Citation
  22. Qazvinian V. &Radev D.R.(2008).Scientific paper summarization using citation summary networks. InProceedings of the 22nd International Conference on Computational Linguistics‐Vol. 1(pp.689–696). Association for Computational Linguistics. · DOI · Paper page
  23. Qazvinian V. &Radev D.R.(2010).Identifying non‐explicit citing sentences for citation‐based summarization. InProceedings of the 48th Annual Meeting of the Association for Computational Linguistics(pp.555–564). Association for Computational Linguistics.
  24. Radev D.R. Muthukrishnan P. &Qazvinian V.(2009).The acl anthology network corpus. InProceedings of the 2009 Workshop on Text and Citation Analysis for Scholarly Digital Libraries(pp.54–61). Association for Computational Linguistics. · DOI · Paper page
  25. Ritchie A. Robertson S. &Teufel S.(2008).Comparing citation contexts for information retrieval. InProceedings of the 17th ACM Conference on Information and Knowledge Management(pp.213–222). ACM. · DOI · Paper page
  26. Siddharthan A. &Teufel S.(2007).Whose idea was this and why does it matter? Attributing scientific work to citations.Proceedings of NAACL/HLT‐07 316–323.
  27. Sugiyama K. Kumar T. Kan M.Y. &Tripathi R.C.(2010).Identifying citing sentences in research papers using supervised learning. InInformation Retrieval & Knowledge Management (CAMP) 2010 International Conference on(pp.67–72). IEEE. · DOI
  28. Tong T. Dinakarpandian D. &Lee Y.(2009).Literature clustering using citation semantics. InSystem Sciences 2009. HICSS'09. 42nd Hawaii International Conference on(pp.1–10). IEEE. · DOI
  29. 10.1002/asi.20872 · DOI
  30. Vapnik V.N., 1999, The Nature of Statistical Learning Theory. Statistics for Engineering and Information Science

Cited by

Metadata

Authors
Wan, X., & Liu, F.
Venue
Journal of the Association for Information Science and Technology
Publisher
Wiley
Published
2014-04-08
Volume
65
Issue
9
Pages
1929-1938
ISSN
  • 2330-1635 (ISSN-L)
  • 2330-1643
OpenAlex
W1601506792
Cited by
66
References
4
FWCI
5.45
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.