Classification of PICO elements by text features systematically extracted from PubMed abstracts.
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
We propose and evaluate a systematic approach to detect and classify Patient/Problem, Intervention, Comparison and Outcome (PICO) from the medical literature. The training and test corpora were generated systematically and automatically from structured PubMed abstracts. 23,472 sentences by exact pattern match of head words of P-I-O categories. Afterward, the terms with top frequencies were used as the features of Naïve Bayesian classifier. This approach achieves F-measure values of 0.91 for Patient/Problem, 0.75 for Intervention and 0.88 for Outcome, comparable to previous studied based on mixed textural, paragraphical, and semantic features. In conclusion, we show that by stricter pattern matching criteria of training set, detection and classification of PICO elements can be reproducible with minimal expert intervention. The results of this work are higher than previous studies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769
Utilization of the PICO framework to improve searching PubMed for clinical questions
Schardt, C., Adams, M. B., Owens, T., Keitz, S., & Fontelo, P. (2007) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-7-16 · Cited by 3,053
The well-built clinical question: A key to evidence-based decisions
(1995) · ACP Journal Club · doi:10.7326/acpjc-1995-123-3-a12 · Cited by 2,931 · cited 1×
“…2) ACQUIRING (SEARCHING): applying a stepwise approach to judge the compatibility of the acquired literature to the present question on in the [3], then 3) APPRAISAL: using adequate critical appraisal tools based on the type of problems to judge the importance and validity of the literature.”
MethodAnswering Clinical Questions with Knowledge-Based and Statistical Techniques
Demner-Fushman, D., & Lin, J. (2007) · Computational Linguistics · doi:10.1162/coli.2007.33.1.63 · Cited by 296
Combining classifiers for robust PICO element detection.
Boudin, F., Nie, J.-Y., Bartlett, J. C., Grad, R., Pluye, P., & Dawes, M. (2010) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-10-29 · Cited by 131
Categorization of sentence types in medical abstracts.
McKnight, L., & Srinivasan, P. (2003) · PubMed · Cited by 126
Sentence retrieval for abstracts of randomized controlled trials.
Chung, G. Y. (2009) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-9-10 · Cited by 83
The role of knowledge in conceptual retrieval: a study in the domain of clinical medicine
Lin, J., & Demner‐Fushman, D. (2006) · International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · doi:10.1145/1148170.1148191 · Cited by 60
Dawes, M. G., Pluye, P., Shea, L., Grad, R. M., Greenberg, A., & Nie, J. (2007) · Journal of Innovation in Health Informatics · doi:10.14236/jhi.v15i1.640 · Cited by 49
Research works printed but not linked: 1
- demner-fushman, 2005, Knowledge Extraction for Clinical Question Answering: Preliminary Results, American Association for Artificial Intelligence
Cited by
PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical AbstractsPreprint
Dernoncourt, F., & Lee, J. Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.06071 · Cited by 320
Automating data extraction in systematic reviews: a systematic review
Jonnalagadda, S. R., Goyal, P., & Huffman, M. D. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0066-7 · Cited by 287
Data extraction methods for systematic review (semi)automation: a living systematic review
Schmidt, L., Olorisade, B. K., McGuinness, L. A., Thomas, J., & Higgins, J. P. T. (2021) · F1000Research · doi:10.12688/f1000research.51117.1 · Cited by 106
Data extraction methods for systematic review (semi)automation: Update of a living systematic review
Schmidt, L., Finnerty, A. N., Elmore, R., Olorisade, B. K., Thomas, J., & Higgins, J. P. T. (2023) · F1000Research · doi:10.12688/f1000research.51117.2 · Cited by 74
Proceedings of the BioNLP 2018 workshop
(2018) · doi:10.18653/v1/w18-23 · Cited by 71
Metadata
- Authors
- Huang, K.-C., Liu, C. C.-H., Yang, S.-S., Xiao, F., Wong, J.-M., Liao, C.-C., & Chiang, I.-J.
- Affiliations
- National Taiwan University (TW)
- Department of Health (TW)
- Venue
- 2011 IEEE International Conference on Granular Computing
- Publisher
- IEEE
- Published
- 2011-11
- Pages
- 279-283
- OpenAlex
- W1969122915
- Cited by
- 26
- References
- 9
- Citations by year
- 2025: 3 · 2024: 2 · 2023: 4 · 2022: 2 · 2021: 2 · 2020: 4 · 2019: 3 · 2018: 2 · 2017: 1 · 2015: 2 · 2013: 1
- FWCI
- 1.17
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE International Conference on Granular Computing (GrC) (publishedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Text and Document Classification Technologies
- Keywords
- clinical trial reporting, text classification, PubMed abstracts, pattern matching, Naive Bayes classifier, text features
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Classification of PICO elements by text features systematically extracted from PubMed abstracts. https://app.cochat.ai/papers/10.1109/grc.2011.6122608
- The paper
- Huang, K.-C., Liu, C. C.-H., Yang, S.-S., Xiao, F., Wong, J.-M., Liao, C.-C., & Chiang, I.-J. (2011). Classification of PICO elements by text features systematically extracted from PubMed abstracts. 2011 IEEE International Conference on Granular Computing. https://doi.org/10.1109/grc.2011.6122608
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.