The DOI matches its Crossref record; the references it cites are not checked yet; 2 of the 3 sources its claims cite were checked for support.
A Novel Diagnostic Decision Support System for Medical Professionals: Prospective Feasibility Study
Open accessPublished version of a preprint
Abstract
Background: Continuously growing medical knowledge and the increasing amount of data make it difficult for medical professionals to keep track of all new information and to place it in the context of existing information. A variety of digital technologies and artificial intelligence–based methods are currently available as persuasive tools to empower physicians in clinical decision-making and improve health care quality. A novel diagnostic decision support system (DDSS) prototype developed by Ada Health GmbH with a focus on traceability, transparency, and usability will be examined more closely in this study. Objective: The aim of this study is to test the feasibility and functionality of a novel DDSS prototype, exploring its potential and performance in identifying the underlying cause of acute dyspnea in patients at the University Hospital Basel. Methods: A prospective, observational feasibility study was conducted at the emergency department (ED) and internal medicine ward of the University Hospital Basel, Switzerland. A convenience sample of 20 adult patients admitted to the ED with dyspnea as the chief complaint and a high probability of inpatient admission was selected. A study physician followed the patients admitted to the ED throughout the hospitalization without interfering with the routine clinical work. Routinely collected health-related personal data from these patients were entered into the DDSS prototype. The DDSS prototype’s resulting disease probability list was compared with the gold-standard main diagnosis provided by the treating physician. Results: The DDSS presented information with high clarity and had a user-friendly, novel, and transparent interface. The DDSS prototype was not perfectly suited for the ED as case entry was time-consuming (1.5-2 hours per case). It provided accurate decision support in the clinical inpatient setting (average of cases in which the correct diagnosis was the first diagnosis listed: 6/20, 30%, SD 2.10%; average of cases in which the correct diagnosis was listed as one of the top 3: 11/20, 55%, SD 2.39%; average of cases in which the correct diagnosis was listed as one of the top 5: 14/20, 70%, SD 2.26%) in patients with dyspnea as the main presenting complaint. Conclusions: The study of the feasibility and functionality of the tool was successful, with some limitations. Used in the right place, the DDSS has the potential to support physicians in their decision-making process by showing new pathways and unintentionally ignored diagnoses. The DDSS prototype had some limitations regarding the process of data input, diagnostic accuracy, and completeness of the integrated medical knowledge. The results of this study provide a basis for the tool’s further development. In addition, future studies should be conducted with the aim to overcome the current limitations of the tool and study design. Trial Registration: ClinicalTrials.gov NCT04827342; https://clinicaltrials.gov/ct2/show/NCT04827342
Overview
CoChat Summary
TL;DR
This prospective feasibility study tested a novel, transparent diagnostic decision support system (DDSS) in 20 hospitalized adults with dyspnea at a Swiss emergency department/internal medicine ward. The tool was judged user-friendly and clear, but case entry was time-consuming and diagnostic performance was limited by incomplete knowledge coverage, user dependence, and the acute-care setting.
Key findings
- In the 20 included cases, the correct diagnosis was the first DDSS suggestion in 6/20 cases (30%), within the top 3 in 11/20 (55%), and within the top 5 in 14/20 (70%).
- Data entry into the prototype took 1.5–2 hours per patient, and the paper states it was “not perfectly suited” for the emergency department because of this time burden.
- Among 33 patients considered, 20 were included (61%); 11/33 (33%) were excluded because they were directly discharged from the ED, and 2/33 (6%) refused participation.
- The authors report that in 10/20 cases (50%), the treating physician did not provide a working/final diagnosis in a way that allowed accuracy assessment, and in 4/20 cases (20%) the final diagnosis was not in the DDSS knowledge base.
Methods
- Prospective, observational feasibility study at the emergency department and internal medicine ward of the University Hospital Basel, Switzerland, conducted from May 2020 to August 2020.
- Convenience sample of 20 adult German-speaking patients admitted with dyspnea as the chief complaint and a high likelihood of inpatient admission; a study physician shadowed routine care without interfering.
- Routine clinical data were entered into the DDSS and compared with hospital diagnoses across visits; accuracy was assessed descriptively and with chi-square tests/Fisher exact tests, with Benjamini–Hochberg correction.
Limitations
- The paper states the small number of cases and the focus on only one presenting symptom are limitations, and notes these create potential selection bias.
- The study was observational and the authors say the results should be interpreted with caution; they call for real-world interventional, larger-scale, and blinded future studies.
- Evident from the text: diagnostic accuracy was hard to evaluate in 10/20 cases because the treating physician did not provide a single ICD-10–compliant main diagnosis; the DDSS was also limited by incomplete knowledge coverage and user-dependent input.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
2 Valid · 0 Not valid · 1 Not checked · 57 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“The DDSS prototype has been examined in a retrospective study with a focus on rare diseases, demonstrating that Ada suggested accurate diagnoses earlier than clinical diagnoses in more than half of all cases [12].”
§ A Novel Diagnostic Decision Support System for Medical Professionals: Prospective Feasibility Study > Introduction > The Diagnostic Decision Support Tool
What the sources say
- Supportedcites [12] source
The Abstract Results report that Ada DX suggested the correct disease before clinical diagnosis in 50 of 93 cases (53.8%), which is more than half. This result applies to diagnoses among the top five fit suggestions; the rate for the top suggestion alone was 37.6%. (LLM, conf=0.92)
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The DDSS prototype was not perfectly suited for the ED as case entry was time-consuming (1.5-2 hours per case).”
- Also stated in: § Feasibility Measures · plain
“The data entry took 1.5-2 hours per patient.”
- Also stated in: § Principal Findings · plain
“However, the tool as currently developed is not perfectly suited to acute medical settings such as the ED as manual case entry is very time-consuming.”
§ A Novel Diagnostic Decision Support System for Medical Professionals: Prospective Feasibility Study > Abstract > Results
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Feasibility Measures · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Those that could not be entered were mainly diagnostic findings, such as radiologic, laboratory, and histologic findings.”
§ A Novel Diagnostic Decision Support System for Medical Professionals: Prospective Feasibility Study > Results > Coverage of Diagnoses in the DDSS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In all the cases, there were one or several entities (out of a large number of relevant entities for each case) that could not be found via the search function in the DDSS (Table 1).”
§ A Novel Diagnostic Decision Support System for Medical Professionals: Prospective Feasibility Study > Results > Coverage of Diagnoses in the DDSS
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Once added to the case, it was not immediately recognizable to the physician how the finding had been marked, which confused the study physician during his work.”
§ A Novel Diagnostic Decision Support System for Medical Professionals: Prospective Feasibility Study > Results > Usability
plainstates a causeSingle case- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
21 more claims
Create a free account to see all 60 claims and to verify the 1 reference still open.
- It may state two separate claims as one. 21
- Probably not a substantial claim. 19
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ A Novel Diagnostic Decision Support System for Medical Professionals: Prospective Feasibility Study > Abstract > Trial Registration
“ClinicalTrials.gov NCT04827342; https://clinicaltrials.gov/ct2/show/NCT04827342”
§ A Novel Diagnostic Decision Support System for Medical Professionals: Prospective Feasibility Study > Methods > Study Design and Case Selection
“We conducted this prospective feasibility study (ClinicalTrials.gov: NCT0482734) at the ED and internal medicine ward of the University Hospital Basel, Switzerland.”
Citations
The citation lists are queued
They are fetched later and appear here then.
References 20 · Cited by 13
Research works printed but not linked: 2
- Ventola, CL, 2014, P T, 39, 356
- Densen, P, 2011, Trans Am Clin Climatol Assoc, 122, 48
Metadata
- Authors
- Timiliotis, J., Blümke, B., Serfözö, P. D., Gilbert, S., Ondrésik, M., Türk, E., Hirsch, M. C., & Eckstein, J.
- Affiliations
- University Hospital of Basel (CH)
- University Hospital Carl Gustav Carus (DE)
- Philipps University of Marburg (DE)
- Corresponding author
- Timiliotis, Joanna
- ORCID
- Venue
- JMIR Formative Research
- Publisher
- JMIR Publications Inc.
- Published
- 2022-03-24
- Volume
- 6
- Issue
- 3
- Pages
- e29943
- ISSN
- 2561-326X (ISSN-L)
- PMC
- PMC8990366
- OpenAlex
- W4206717700
- Cited by
- 13
- References
- 20
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 1 · 2023: 2 · 2022: 3
- FWCI
- 0.75
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Formative Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- diagnostic decision support systems, clinical decision support, acute dyspnea, emergency department, inpatient diagnosis, medical knowledge integration, usability, physician decision-making, diagnostic accuracy, artificial intelligence in healthcare
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Novel Diagnostic Decision Support System for Medical Professionals: Prospective Feasibility Study. https://app.cochat.ai/papers/10.2196/29943
- The paper
- Timiliotis, J., Blümke, B., Serfözö, P. D., Gilbert, S., Ondrésik, M., Türk, E., Hirsch, M. C., & Eckstein, J. (2022). A Novel Diagnostic Decision Support System for Medical Professionals: Prospective Feasibility Study. JMIR Formative Research. https://doi.org/10.2196/29943
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

