KETOS: Clinical decision support and machine learning as a service – A training and deployment platform based on Docker, OMOP-CDM, and FHIR Web Services
Open accessThe DOI matches its Crossref record; 30 of the 33 references it cites were found in a registry or an index.
Abstract
BACKGROUND AND OBJECTIVE: To take full advantage of decision support, machine learning, and patient-level prediction models, it is important that models are not only created, but also deployed in a clinical setting. The KETOS platform demonstrated in this work implements a tool for researchers allowing them to perform statistical analyses and deploy resulting models in a secure environment. METHODS: The proposed system uses Docker virtualization to provide researchers with reproducible data analysis and development environments, accessible via Jupyter Notebook, to perform statistical analysis and develop, train and deploy models based on standardized input data. The platform is built in a modular fashion and interfaces with web services using the Health Level 7 (HL7) Fast Healthcare Interoperability Resources (FHIR) standard to access patient data. In our prototypical implementation we use an OMOP common data model (OMOP-CDM) database. The architecture supports the entire research lifecycle from creating a data analysis environment, retrieving data, and training to final deployment in a hospital setting. RESULTS: We evaluated the platform by establishing and deploying an analysis and end user application for hemoglobin reference intervals within the University Hospital Erlangen. To demonstrate the potential of the system to deploy arbitrary models, we loaded a colorectal cancer dataset into an OMOP database and built machine learning models to predict patient outcomes and made them available via a web service. We demonstrated both the integration with FHIR as well as an example end user application. Finally, we integrated the platform with the open source DataSHIELD architecture to allow for distributed privacy preserving data analysis and training across networks of hospitals. CONCLUSION: The KETOS platform takes a novel approach to data analysis, training and deploying decision support models in a hospital or healthcare setting. It does so in a secure and privacy-preserving manner, combining the flexibility of Docker virtualization with the advantages of standardized vocabularies, a widely applied database schema (OMOP-CDM), and a standardized way to exchange medical data (FHIR).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures






Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Federated learning is a viable method to connect EHR data from medical institutions, allowing them to share their experiences, and not their data, with a guarantee of privacy [9, 25, 34, 45, 65, 82].”
From Federated Learning for Healthcare Informatics (2021) · cites this paper as [34]
Experimental — accuracy not yet measuredIn the citing paper
“FL is a highly effective method to gather EHR data from hospitals to provide a knowledge-sharing platform without the need of sharing personal data, all while preserving the privacy [104, 105].”
From Federated learning-based AI approaches in smart healthcare: Concepts, taxonomies, challenges and open issues (2023) · cites this paper as [104]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
UCI Machine Learning Repository
Asuncion, A. (2007) · Medical Entomology and Zoology · Cited by 25,410
George, H., Duke Jon, D., Shah Nigam, H., Reich Christian, G., Vojtech, H., Schuemie Martijn, J., Suchard Marc, A., Woong, P. R., Kei, W. I. C., Rijnbeek Peter, R., et al. (2015) · Studies in Health Technology and Informatics · doi:10.3233/978-1-61499-564-7-574 · Cited by 1,542
How Can We Increase Translation of Research into Practice? Types of Evidence Needed
Glasgow, R. E., & Emmons, K. M. (2007) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.28.021406.144145 · Cited by 1,050
SMART on FHIR: a standards-based, interoperable apps platform for electronic health records
Mandel, J. C., Kreda, D. A., Mandl, K. D., Kohane, I. S., & Ramoni, R. B. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv189 · Cited by 829
General Data Protection Regulation (GDPR)
Deaves, M. (2017) · Cited by 816
NiftyNet: a deep-learning platform for medical imaging
Gibson, E., Li, W., Sudre, C., Fidon, L., Shakir, D. I., Wang, G., Eaton-Rosen, Z., Gray, R., Doel, T., Hu, Y., et al. (2018) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2018.01.025 · Cited by 552
The HUGO Gene Nomenclature Committee (HGNC)
Povey, S., Lovering, R., Bruford, E., Wright, M., Lush, M., & Wain, H. (2001) · Human Genetics · doi:10.1007/s00439-001-0615-0 · Cited by 508
DataSHIELD: taking the analysis to the data, not the data to the analysis
Gaye, A., Marcon, Y., Isaeva, J., LaFlamme, P., Turner, A., Jones, E. M., Minion, J., Boyd, A. W., Newby, C. J., Nuotio, M.-L., et al. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu188 · Cited by 284 · cited 1×
“We have shown that our platform integrates easily with existing distributed privacy preserving data analysis solutions like DataSHIELD [41].”
MethodBischl, B., Lang, M., Kotthoff, L., Schratz, P., Schiffner, J., Richter, J., Jones, Z., Casalicchio, G., Gallo, M., & Binder, M. (2013) · CRAN: Contributed Packages · doi:10.32614/cran.package.mlr · Cited by 277
Semler, S., Wissing, F., & Heyder, R. (2018) · Methods of Information in Medicine · doi:10.3414/me18-03-0003 · Cited by 230
Fortier, I., Burton, P. R., Robson, P. J., Ferretti, V., Little, J., L'Heureux, F., Deschenes, M., Knoppers, B. M., Doiron, D., Keers, J. C., et al. (2010) · International Journal of Epidemiology · doi:10.1093/ije/dyq139 · Cited by 176
HiGHmed – An Open Platform Approach to Enhance Care and Research across Institutional Boundaries
Haarbrandt, B., Schreiweis, B., Rey, S., Sax, U., Scheithauer, S., Rienhoff, O., Knaup, P., Bavendiek, U., Dieterich, C., Brors, B., et al. (2018) · Methods of Information in Medicine · doi:10.3414/me18-02-0002 · Cited by 155
MIRACUM: Medical Informatics in Research and Care in University Medicine
Prokosch, H., Acker, T., Bernarding, J., Binder, H., Boeker, M., Boerries, M., Daumke, P., Ganslandt, T., Hesser, J., Höning, G., et al. (2018) · Methods of Information in Medicine · doi:10.3414/me17-02-0025 · Cited by 146
Self-citationWinter, A., Stäubert, S., Ammon, D., Aiche, S., Beyan, O., Bischoff, V., Daumke, P., Decker, S., Funkat, G., Gewehr, J., et al. (2018) · Methods of Information in Medicine · doi:10.3414/me18-02-0004 · Cited by 130
Obstacles and opportunities in translational research
Hörig, H., Marincola, E., & Marincola, F. M. (2005) · Nature Medicine · doi:10.1038/nm0705-705 · Cited by 117 · cited 1×
“Typically, deployment of such statistical computations has faced several political, social, economic and organizational challenges [1–3].”
BackgroundClinical Decision Support Systems (CDSS) for preventive management of COPD patients
Velickovski, F., Ceccaroni, L., Roca, J., Burgos, F., Galdiz, J. B., Marina, N., & Lluch-Ariet, M. (2014) · Journal of Translational Medicine · doi:10.1186/1479-5876-12-s2-s9 · Cited by 102
Data Integration for Future Medicine (DIFUTURE): An Architectural and Methodological Overview
Prasser, F., Kohlbacher, O., Mansmann, U., Bauer, B., & Kuhn, K. (2018) · Methods of Information in Medicine · doi:10.3414/me17-02-0022 · Cited by 100
Towards Implementation of OMOP in a German University Hospital Consortium
Maier, C., Lang, L., Storf, H., Vormstein, P., Bieber, R., Bernarding, J., Herrmann, T., Haverkamp, C., Horki, P., Laufer, J., et al. (2018) · Applied Clinical Informatics · doi:10.1055/s-0037-1617452 · Cited by 90
Self-citationTranslational medicine: science or wishful thinking?
Wehling, M. (2008) · Journal of Translational Medicine · doi:10.1186/1479-5876-6-31 · Cited by 76
General Data Protection Regulation (GDPR)
Barezzani, S. (2023) · Springer eBooks · doi:10.1007/978-3-642-27739-9_1811-1 · Cited by 65
Fast Health Interoperability Resources (FHIR): Current Status in the Healthcare System
Saripalle, R. K. (2019) · International Journal of E-Health and Medical Communications · doi:10.4018/ijehmc.2019010105 · Cited by 50
Vreeman, D. J., McDonald, C. J., & Huff, S. M. (2010) · International Journal of Functional Informatics and Personalised Medicine · doi:10.1504/ijfipm.2010.040211 · Cited by 45
Clinical Predictive Modeling Development and Deployment through FHIR Web Services.
Khalilia, M. A., Choi, M., Henderson, A., Iyengar, S., Braunstein, M. L., & Sun, J. (2015) · PubMed · Cited by 44
mlbench: Machine Learning Benchmark Problems
Leisch, F., & Dimitriadou, E. (1999) · doi:10.32614/cran.package.mlbench · Cited by 36
Zierk, J., Arzideh, F., Haeckel, R., Rauh, M., Metzler, M., Ganslandt, T., & Krause, S. W. (2018) · Clinical Chemistry and Laboratory Medicine (CCLM) · doi:10.1515/cclm-2018-0771 · Cited by 22
Self-citationPredicting Clinical Outcomes in Colorectal Cancer Using Machine Learning
Julian, G., Prokosch, H., Michael, S., Croner, R. S., Christoph, J., & Toddenroth, D. (2018) · Studies in health technology and informatics · doi:10.3233/978-1-61499-852-5-101 · Cited by 19
Self-citationSoto, G. E., & Spertus, J. A. (2007) · Computers in cardiology · doi:10.1109/cic.2007.4745457 · Cited by 14
MAGPIE: Simplifying access and execution of computational models in the life sciences
Baldow, C., Salentin, S., Schroeder, M., Roeder, I., & Glauche, I. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005898 · Cited by 7
Gruendner, J., Prokosch, H., Schindler, S., Lenz, S., & Binder, H. (2019) · Studies in health technology and informatics · doi:10.3233/978-1-61499-959-1-115 · Cited by 5
Self-citation[SNOMED (Systematized Nomenclature of Medicine) - multiaxial data registration].
Laursen, S. O. (1981) · PubMed · Cited by 1
Research works printed but not linked: 1
- N Hughes, Liberating Evidence via Harmonisation of EU Real world data
Cited by
Federated Learning for Healthcare Informatics
Xu, J., Glicksberg, B. S., Su, C., Walker, P., Bian, J., & Wang, F. (2021) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-020-00082-4 · Cited by 1,542
“Federated learning is a viable method to connect EHR data from medical institutions, allowing them to share their experiences, and not their data, with a guarantee of privacy [8,27,74,19,57,37].”
MethodFederated Learning for Healthcare Informatics
Xu, J., Glicksberg, B. S., Su, C., Walker, P., Bian, J., & Wang, F. (2019) · arXiv · doi:10.48550/arxiv.1911.06270 · Cited by 1,538
Rahman, A., Hossain, M. S., Muhammad, G., Kundu, D., Debnath, T., Rahman, M., Khan, M. S. I., Tiwari, P., & Band, S. S. (2023) · Cluster Computing · doi:10.1007/s10586-022-03658-4 · Cited by 399
“FL is a highly effective method to gather EHR data from hospitals to provide a knowledge-sharing platform without the need of sharing personal data, all while preserving the privacy [104, 105].”
MethodWinter, A., Stäubert, S., Ammon, D., Aiche, S., Beyan, O., Bischoff, V., Daumke, P., Decker, S., Funkat, G., Gewehr, J., et al. (2018) · Methods of Information in Medicine · doi:10.3414/me18-02-0004 · Cited by 130
Rahimi, A. K., Pienaar, O., Ghadimi, M., Canfell, O. J., Pole, J. D., Shrapnel, S., van der Vegt, A. H., & Sullivan, C. M. (2024) · Journal of Medical Internet Research · doi:10.2196/49655 · Cited by 164
“To mitigate this risk, hospitals can adopt validated open-source software with appropriate security and privacy measures, such as standardized databases and interoperability protocols [24,34,35,39,45].”
Influential
Metadata
- Authors
- Gruendner, J., Schwachhofer, T., Sippl, P., Wolf, N., Erpenbeck, M., Gulden, C., Kapsner, L. A., Zierk, J., Mate, S., Stürzl, M., Croner, R., Prokosch, H.-U., & Toddenroth, D.
- Affiliations
- Friedrich-Alexander-Universität Erlangen-Nürnberg (DE)
- Universitätsklinikum Erlangen (DE)
- University Hospital Magdeburg (DE)
- Corresponding author
- Gruendner, Julian
- ORCID
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2019-10-03
- Volume
- 14
- Issue
- 10
- Pages
- e0223010
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC6776354
- OpenAlex
- W2977456252
- Cited by
- 54
- References
- 33
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 11 · 2023: 7 · 2022: 13 · 2021: 8 · 2020: 4 · 2019: 1
- FWCI
- 7.08
- Type
- journal article
- Language
- en
- Update notices
- correction (2019-11-13)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- OPUS FAU (Kooperativer Bibliotheksverbund Berlin-Brandenburg (KOBV), on behalf of the Universitätsbibliothek Erlangen-Nürnberg) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Bundesministerium für Bildung und Forschung (FKZ:01ZZ1801A, 01ZZ1801A)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- clinical decision support, machine learning deployment, OMOP Common Data Model, reproducible data analysis, Jupyter notebooks, DataSHIELD, privacy-preserving data analysis, health data interoperability, research data security
- MeSH terms
- Machine Learning, Health Information Interoperability, Hemoglobins, Humans, Models, Theoretical, Reference Values, User-Computer Interface, Colorectal Neoplasms, Treatment Outcome, Privacy, Decision Support Systems, Clinical, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.