The structural and content aspects of abstracts versus bodies of full text journal articles are different
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
BACKGROUND: An increase in work on the full text of journal articles and the growth of PubMedCentral have the opportunity to create a major paradigm shift in how biomedical text mining is done. However, until now there has been no comprehensive characterization of how the bodies of full text journal articles differ from the abstracts that until now have been the subject of most biomedical text mining research. RESULTS: We examined the structural and linguistic aspects of abstracts and bodies of full text articles, the performance of text mining tools on both, and the distribution of a variety of semantic classes of named entities between them. We found marked structural differences, with longer sentences in the article bodies and much heavier use of parenthesized material in the bodies than in the abstracts. We found content differences with respect to linguistic features. Three out of four of the linguistic features that we examined were statistically significantly differently distributed between the two genres. We also found content differences with respect to the distribution of semantic features. There were significantly different densities per thousand words for three out of four semantic classes, and clear differences in the extent to which they appeared in the two genres. With respect to the performance of text mining tools, we found that a mutation finder performed equally well in both genres, but that a wide variety of gene mention systems performed much worse on article bodies than they did on abstracts. POS tagging was also more accurate in abstracts than in article bodies. CONCLUSIONS: Aspects of structure and content differ markedly between article abstracts and article bodies. A number of these differences may pose problems as the text mining field moves more into the area of processing full-text articles. However, these differences also present a number of opportunities for the extraction of data types, particularly that found in parenthesized text, that is present in article bodies but not in article abstracts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“As quoted from Cohen, Johnson, Verspoor, Roeder and Hunter [83]: ' Full-text articles can also present other challenges, such as the recognition and clean-up of embedded tags, non-ASCII characters, tables and figures, and even the need to convert from PDF to textual format. Access to full text is an especially troublesome issue ' [83] .”
From Automation of systematic literature reviews: A systematic literature review (2021) · cites this paper as [83]
In the citing paper
“[13,14,83] describe that this is because titles and abstracts are significantly different from full-texts.”
From Automation of systematic literature reviews: A systematic literature review (2021) · cites this paper as [83]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Jurafsky, D. S., & Martin, J. (2000) · Cited by 4,132
Accurate unlexicalized parsing
Klein, D., & Manning, C. D. (2003) · Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - ACL '03 · doi:10.3115/1075096.1075150 · Cited by 3,008 · cited 1×
“6) ([30]) to a subsection of the CRAFT corpus.”
BackgroundA Simple Algorithm for Identifying Negated Findings and Diseases in Discharge Summaries
Chapman, W. W., Bridewell, W., Hanbury, P., Cooper, G. F., & Buchanan, B. G. (2001) · Journal of Biomedical Informatics · doi:10.1006/jbin.2001.1029 · Cited by 1,118 · cited 1×
“We looked at the incidence of negation because like conjunction, handling negation is a perennial problem in natural language processing [18-21].”
BackgroundProceedings of the AMIA Symposium
Schulz, S., Daumke, P., Smith, B., & Hahn, U. (2005) · Cited by 606
Overview of BioCreAtIvE: critical assessment of information extraction for biology
Hirschman, L., Yeh, A., Blaschke, C., & Valencia, A. (2005) · BMC Bioinformatics · doi:10.1186/1471-2105-6-s1-s1 · Cited by 530 · cited 1×
“In the very recent past, the TREC Genomics [10] and BioCreative competitions [11,12] have led to a large increase in work on full-text articles.”
BackgroundFriedman, C., Kra, P., Yu, H., Krauthammer, M., & Rzhetsky, A. (2001) · Bioinformatics · doi:10.1093/bioinformatics/17.suppl_1.s74 · Cited by 507
BANNER: AN EXECUTABLE SURVEY OF ADVANCES IN BIOMEDICAL NAMED ENTITY RECOGNITION
LEAMAN, R., & GONZALEZ, G. (2007) · Biocomputing 2008 · doi:10.1142/9789812776136_0062 · Cited by 479
ABNER: an open source tool for automatically tagging genes, proteins and other entity names in text
Settles, B. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti475 · Cited by 468
Procedure for quantitatively comparing the syntactic coverage of English grammars
Klavans, J., Liberman, M., Marcus, M., Roukos, S., Santorini, B., Strzalkowski, T., Abney, S., Flickenger, S., Gdaniec, C., Grishman, C., et al. (1991) · Proceedings of the workshop on Speech and Natural Language - HLT '91 · doi:10.3115/112405.112467 · Cited by 432
Mutalik, P. G., Deshpande, A., & Nadkarni, P. M. (2001) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2001.0080598 · Cited by 249
Research works printed but not linked: 4
- Nakov PI, Schwartz AS, Hearst MA: Citances: Citation sentences for semantic analysis of bioscience text. SIGIR'04 Workshop on Search and Discovery in Bioinformatics 2004.
- Goldin I, Chapman W: Learning to detect negation with 'not' in medical texts. Proceedings of the ACM SIGIR 2003.
- Gasperin C, Karamanis N, Seal R: Annotation of anaphoric relations in biomedical full-text articles using a domain-relevant scheme. Proceedings of DAARC 2007 2007.
- Alias-i : LingPipe 3.1.2. 2008.
Cited by
Two new Later Stone Age sites from the Final Pleistocene in the Falémé Valley, eastern Senegal
Ndiaye, M., Lespez, L., Tribolo, C., Rassé, M., Hadjas, I., Davidoux, S., Huysecom, É., & Douze, K. (2024) · Monash University Research Portal (Monash University) · doi:10.3929/ethz-b-000667478 · Cited by 23,868
SPECTER: Document-level Representation Learning using Citation-informed Transformers
Cohan, A., Feldman, S., Beltagy, I., Downey, D., & Weld, D. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.207 · Cited by 1,108
O’Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-5 · Cited by 681
“Cohen and colleagues have investigated more widely the implications for text mining of processing abstracts as opposed to full-text articles, and moreover mention a second issue, to do with problems that may arise for systems in going from the processing of abstracts to the processing of full text, but note that there…”
BackgroundAutomation of systematic literature reviews: A systematic literature review
van Dinter, R., Tekinerdogan, B., & Catal, C. (2021) · Information and Software Technology · doi:10.1016/j.infsof.2021.106589 · Cited by 432
“Access to full text is an especially troublesome issue ” [83] .”
BackgroundPubTator central: automated concept annotation for biomedical full text articles
Wei, C.-H., Allot, A., Leaman, R., & Lu, Z. (2019) · Nucleic Acids Research · doi:10.1093/nar/gkz389 · Cited by 400
“Previous work has shown that the content of the full article text is substantially different from the abstracts (49).”
Background
Metadata
- Authors
- Cohen, K. B., Johnson, H. L., Verspoor, K., Roeder, C., & Hunter, L. E.
- Affiliations
- University of Colorado Boulder (US)
- University of Colorado Anschutz (US)
- Corresponding author
- Cohen, K Bretonnel
- Venue
- BMC Bioinformatics
- Published
- 2010-09-29
- Volume
- 11
- Issue
- 1
- Pages
- 492-492
- ISSN
- 1471-2105 (ISSN-L)
- PMC
- PMC3098079
- OpenAlex
- W2075322787
- Cited by
- 174
- References
- 33
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 6 · 2023: 4 · 2022: 8 · 2021: 12 · 2020: 9 · 2019: 6 · 2018: 9 · 2017: 10 · 2016: 8 · 2015: 13 · 2014: 32 · 2013: 14 · 2012: 27
- FWCI
- 6.52
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- BMC Bioinformatics (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- National Institute of General Medical Sciences (R01GM083649)
- U.S. National Library of Medicine (R01LM008111, R01LM009254, 1 R01LM010120-D1, R01LM010120)
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Keywords
- biomedical text mining, part-of-speech tagging, PubMed Central
- MeSH terms
- Abstracting and Indexing, Natural Language Processing, Terminology as Topic, Periodicals as Topic, MEDLINE, Information Storage and Retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The structural and content aspects of abstracts versus bodies of full text journal articles are different. https://app.cochat.ai/papers/10.1186/1471-2105-11-492
- The paper
- Cohen, K. B., Johnson, H. L., Verspoor, K., Roeder, C., & Hunter, L. E. (2010). The structural and content aspects of abstracts versus bodies of full text journal articles are different. BMC Bioinformatics. https://doi.org/10.1186/1471-2105-11-492
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.