CoChat

Combination of conditional random field with a rule based method in the extraction of PICO elements.

Open access
Chabou, Samir, Iglewski, Michal · 2018 · BMC Medical Informatics and Decision Making

The DOI matches its Crossref record; 31 of the 33 references it cites were found in a registry or an index.

Abstract

BACKGROUND: Extracting primary care information in terms of Patient/Problem, Intervention, Comparison and Outcome, known as PICO elements, is difficult as the volume of medical information expands and the health semantics is complex to capture it from unstructured information. The combination of the machine learning methods (MLMs) with rule based methods (RBMs) could facilitate and improve the PICO extraction. This paper studies the PICO elements extraction methods. The goal is to combine the MLMs with the RBMs to extract PICO elements in medical papers to facilitate answering clinical questions formulated with the PICO framework. METHODS: First, we analyze the aspects of the MLM model that influence the quality of the PICO elements extraction. Secondly, we combine the MLM approach with the RBMs in order to improve the PICO elements retrieval process. To conduct our experiments, we use a corpus of 1000 abstracts. RESULTS: We obtain an F-score of 80% for P element, 64% for the I element and 92% for the O element. Given the nature of the used training corpus where P and I elements represent respectively only 6.5 and 5.8% of total sentences, the results are competitive with previously published ones. CONCLUSIONS: Our study of the PICO element extraction shows that the task is very challenging. The MLMs tend to have an acceptable precision rate but they have a low recall rate when the corpus is not representative. The RBMs backed up the MLMs to increase the recall rate and consequently the combination of the two methods gave better results.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s12911-018-0699-2

Cites

31 of 31 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig. 1 PICO element extraction system
Fig. 1 PICO element extraction systemCC BY · PubMed Central
Fig. 2 Incorporation of RBMs in the MLM classification process
Fig. 2 Incorporation of RBMs in the MLM classification processCC BY · PubMed Central
Fig. 3 Conceptualization of the element P as a relationship between two UMLS groups: Disorders and Group
Fig. 3 Conceptualization of the element P as a relationship between two UMLS groups: Disorders and GroupCC BY · PubMed Central
Fig. 4 Conceptualization of the element I as a relation between UMLS semantic group and UMLS semantic network
Fig. 4 Conceptualization of the element I as a relation between UMLS semantic group and UMLS semantic networkCC BY · PubMed Central
Fig. 5 F-score quality for different models
Fig. 5 F-score quality for different modelsCC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 31 references

Research works printed but not linked: 5

  1. Boudin F, Nie JYN, Clinical DM. Information Retrieval using Document and PICO Structure. Paper presented at: HLT ‘10 Human Language Technologies; 2010.
  2. Amini I, Martinez D, Molla D. Overview of the ALTA 2012 Shared Task. Paper presented at: Proc. of the Australasian Language Technology Association Workshop 2012; 2012.
  3. The Apache Software Foundation. Apache cTAKES. 2014. Available at: http://ctakes.apache.org /.
  4. Chabou S, Iglewski M. PICO Extraction by combining the robustness of machine-learning methods with the rule-based methods. Paper presented at. Hammamet: The World Congress on Information Technology and Computer Applications (WCITCA);June; 2015.
  5. Sarker AMDPC. An approach for automatic multi-label classification of medical sentences. Paper presented at: Proceedings of the 4th international Louhi workshop on health document text mining and information analysis. Sydney; 2013.

Cited by

See all 21

Metadata

Authors
Chabou, S., & Iglewski, M.
Affiliations
Université du Québec en Outaouais (CA)
Corresponding author
Iglewski, Michal
Venue
BMC Medical Informatics and Decision Making
Published
2018-12
Volume
18
Issue
1
Pages
128-128
ISSN
1472-6947 (ISSN-L)
OpenAlex
W2902726914
Cited by
19
References
33
Citations by year
2026: 2 · 2025: 3 · 2024: 2 · 2023: 3 · 2022: 4 · 2021: 3 · 2020: 2
FWCI
0.44
Type
journal article
Language
en
Open access
Licence
  • cc-by
  • creativecommons.org/licenses/by/4.0/ (tdm)
Locations
  • BMC Medical Informatics and Decision Making (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, other-oa)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
  • Physical Sciences › Computer Science › Artificial Intelligence › Advanced Text Analysis Techniques
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords
conditional random fields, rule-based methods, medical question answering, medical abstracts
MeSH terms
Machine Learning, Humans, Medical Informatics Applications, Natural Language Processing, Models, Statistical, Data Mining

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Combination of conditional random field with a rule based method in the extraction of PICO elements. https://app.cochat.ai/papers/10.1186/s12911-018-0699-2
The paper
Chabou, S., & Iglewski, M. (2018). Combination of conditional random field with a rule based method in the extraction of PICO elements. BMC Medical Informatics and Decision Making. https://doi.org/10.1186/s12911-018-0699-2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.