CTrO-Editor: A Web-based Tool to Capture Clinical Trial Data for Aggregation and Pooling
The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
As the number of clinical trials carried out and published worldwide keeps growing, better tools for synthesizing the available knowledge become increasingly important. It still requires a significant effort and expertise to aggregate the evidence and results from different clinical trials, a task that is at the core of secondary or comparative studies, meta-analyses, and (living) systematic reviews. Our hypothesis is that the practical challenges involved in synthesizing evidence can be alleviated if the results of clinical trials would be published in a machine-readable format using a well-defined (semantic) vocabulary. Building on the C-TrO ontology that we developed in earlier work to support the aggregation of evidence from clinical trials as the main use case, in this paper we examine the question whether it is feasible for clinical researchers and medical practitioners to describe the results of clinical trials using the C-TrO ontology. For this purpose, we implemented a Web-based tool called CTrO-Editor that uses a form-based interaction paradigm to allow users to enter all the details regarding study population, arms, endpoints, observations and results of a clinical trial, and that exports the data in an RDF format. We describe the results of the evaluation of the CTrO-Editor with five medical students. Our preliminary results suggest that our paradigm for semantifying clinical trials is feasible, as the students could all successfully model a publication of their choice using our tool within a couple of hours.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Current research efforts addressing this issue are focusing on the development of complex interoperability standards such as the FHIR Resources for Evidence-Based Medicine Knowledge Assets, also known as EBMonFHIR [47], or an ongoing effort called C-TrO, to describe clinical trial data in ontology-format and to develop web-based tools for sharing and analysis to support automation in this workflow”
From A narrative review of recent tools and innovations toward automating living systematic reviews and evidence syntheses (2023) · cites this paper as [49]
Citations
Cites
'Scoping the scope' of a cochrane review
Armstrong, R., Hall, B. J., Doyle, J., & Waters, E. (2011) · Journal of Public Health · doi:10.1093/pubmed/fdr015 · Cited by 1,260
Product review: Covidence (systematic review software)
Babineau, J. (2014) · Journal of the Canadian Health Libraries Association / Journal de l'Association des bibliothèques de la santé du Canada · doi:10.5596/c14-016 · Cited by 721
Living systematic review: 1. Introduction-the why, what, when, and how
Elliott, J. H., Synnot, A., Turner, T., Simmonds, M., Akl, E. A., McDonald, S., Salanti, G., Meerpohl, J., MacLehose, H., Hilton, J., et al. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.08.010 · Cited by 655
Kohl, C., McIntosh, E. J., Unger, S., Haddaway, N. R., Kecke, S., Schiemann, J., & Wilhelm, R. (2018) · Environmental Evidence · doi:10.1186/s13750-018-0115-5 · Cited by 471
Kellermeyer, L., Harnke, B., & Knight, S. (2018) · Journal of the Medical Library Association · doi:10.5195/jmla.2018.513 · Cited by 380
On behalf of the founding members of the ICASR group, Beller, E., Clark, J., Tsafnat, G., Adams, C., Diehl, H., Lund, H., Ouzzani, M., Thayer, K., Thomas, J., et al. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0740-7 · Cited by 191
What have we learned after ten years of systematic reviews in international development?
Waddington, H. S., Masset, E., & Jiménez, E. (2018) · Journal of Development Effectiveness · doi:10.1080/19439342.2018.1441166 · Cited by 35
Stay alive! What are living systematic reviews and what are their advantages and challenges?
Winters, M., de Vos, R., van Middelkoop, M., Rathleff, M. S., & Weir, A. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2020-103490 · Cited by 13
Research works printed but not linked: 5
- Covidence. [n.,d.]. Covidence systematic review software . www.covidence.org Retrieved July 7, 2021 from Covidence. [n.,d.]. Covidence systematic review software . www.covidence.org Retrieved July 7, 2021 from
- Svetlana Kiritchenko , Berry De Bruijn , Simona Carini, Joel Martin, and Ida Sim. 2010 . ExaCT: automatic extraction of clinical trial characteristics from journal publications. BMC medical informatics and decision making , Vol. 10 (2010), 56. Svetlana Kiritchenko, Berry De Bruijn, Simona Carini, Joel Martin, and Ida Sim. 2010. ExaCT: automatic extraction of clinical trial characteristics from journal publications. BMC medical informatics and decision making , Vol. 10 (2010), 56.
- Olivia Sanchez-Graillet , Philipp Cimiano , Christian Witte , and Basil Ell . 2019 . C-TrO: An Ontology for Summarization and Aggregation of the Level of Evidence in Clinical Trials . In Proc. of the 5th Joint Ontology Workshops (JOWO): Ontologies and Data in the Life Sciences . Olivia Sanchez-Graillet, Philipp Cimiano, Christian Witte, and Basil Ell. 2019. C-TrO: An Ontology for Summarization and Aggregation of the Level of Evidence in Clinical Trials. In Proc. of the 5th Joint Ontology Workshops (JOWO): Ontologies and Data in the Life Sciences .
- The Cochrane Organization . 2019 b . Publishing living evidence. Living Evidence Network "state of the science" webinar. https://community.cochrane.org/sites/default/files/uploads/inline-files/Transform/ 2019 07_LEN_Publishing_Slides.pdf Retrieved May 5, 2021 from The Cochrane Organization. 2019 b. Publishing living evidence. Living Evidence Network "state of the science" webinar. https://community.cochrane.org/sites/default/files/uploads/inline-files/Transform/201907_LEN_Publishing_Slides.pdf Retrieved May 5, 2021 from
- Mark D Wilkinson , Michel Dumontier , G Aalbersberg , Ij J a Appleton, et almbox . 2016 . The FAIR Guiding Principles for scientific data management and stewardship. Scientific data , Vol. 3 , 160018 (2016). Mark D Wilkinson, Michel Dumontier, G Aalbersberg, Ij J a Appleton, et almbox. 2016. The FAIR Guiding Principles for scientific data management and stewardship. Scientific data , Vol. 3, 160018 (2016).
Cited by
Schmidt, L., Sinyor, M., Webb, R. T., Marshall, C., Knipe, D., Eyles, E. C., John, A., Gunnell, D., & Higgins, J. P. T. (2023) · Zeitschrift für Evidenz, Fortbildung und Qualität im Gesundheitswesen · doi:10.1016/j.zefq.2023.06.007 · Cited by 31
Synthesizing evidence from clinical trials with dynamic interactive argument trees
Sanchez-Graillet, O., Witte, C., Grimm, F., Grautoff, S., Ell, B., & Cimiano, P. (2022) · Journal of Biomedical Semantics · doi:10.1186/s13326-022-00270-8 · Cited by 6
“In a recent study [29], we have shown that the semantic modelling of clinical trials based on the C-TrO ontology is feasible using an editor called CTrO-Editor that has been designed for this purpose.”
MethodSelf-citationOpen challenges for the automatic synthesis of clinical trials
Sanchez-Graillet, O., Schmidt, D. M., Kullik, C., & Cimiano, P. (2025) · BMC Research Notes · doi:10.1186/s13104-025-07121-6 · Cited by 2
“Tools should be used to enable the input of CT information into a structured template, following an ontology or knowledge graph structure, to ensure that the information is machine-readable (e.g., CTrO-Editor [19]).”
Self-citation
Metadata
- Authors
- Sanchez-Graillet, O., Kramer-Sunderbrink, A., & Cimiano, P.
- Affiliations
- Bielefeld University (DE)
- Venue
- Proceedings of the 11th Knowledge Capture Conference
- Publisher
- ACM
- Published
- 2021-12-02
- Pages
- 277-280
- OpenAlex
- W3217781909
- Cited by
- 3
- References
- 8
- Citations by year
- 2025: 1 · 2023: 1 · 2022: 1
- FWCI
- 0.23
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Knowledge Capture (publishedVersion)
- PUB – Publications at Bielefeld University (Bielefeld University) (submittedVersion)
- Funders
- Deutsche Forschungsgemeinschaft (376059226 SPP-1999)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Semantic Web and Ontologies
- Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Keywords
- semantic vocabulary, RDF, web-based editor, evidence aggregation, meta-analysis, systematic reviews, medical students, usability evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: CTrO-Editor: A Web-based Tool to Capture Clinical Trial Data for Aggregation and Pooling. https://app.cochat.ai/papers/10.1145/3460210.3493576
- The paper
- Sanchez-Graillet, O., Kramer-Sunderbrink, A., & Cimiano, P. (2021). CTrO-Editor: A Web-based Tool to Capture Clinical Trial Data for Aggregation and Pooling. Proceedings of the 11th Knowledge Capture Conference. https://doi.org/10.1145/3460210.3493576
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.