CoChat

Systematic analysis of the test design and performance of AI/ML-based medical devices approved for triage/detection/diagnosis in the USA and Japan

Open access
Yuba, Mitsuru, Iwasaki, Kiyotaka · 2022 · Scientific Reports

The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.

Abstract

The development of computer-aided detection (CAD) using artificial intelligence (AI) and machine learning (ML) is rapidly evolving. Submission of AI/ML-based CAD devices for regulatory approval requires information about clinical trial design and performance criteria, but the requirements vary between countries. This study compares the requirements for AI/ML-based CAD devices approved by the US Food and Drug Administration (FDA) and the Pharmaceuticals and Medical Devices Agency (PMDA) in Japan. A list of 45 FDA-approved and 12 PMDA-approved AI/ML-based CAD devices was compiled. In the USA, devices classified as computer-aided simple triage were approved based on standalone software testing, whereas devices classified as computer-aided detection/diagnosis were approved based on reader study testing. In Japan, however, there was no clear distinction between evaluation methods according to the category. In the USA, a prospective randomized controlled trial was conducted for AI/ML-based CAD devices used for the detection of colorectal polyps, whereas in Japan, such devices were approved based on standalone software testing. This study indicated that the different viewpoints of AI/ML-based CAD in the two countries influenced the selection of different evaluation methods. This study’s findings may be useful for defining a unified global development and approval standard for AI/ML-based CAD.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41598-022-21426-7

Cites

29 of 29 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Flowchart for extraction of AI/ML-based CAD devices approved in the USA and Japan.
Figure 1 Flowchart for extraction of AI/ML-based CAD devices approved in the USA and Japan.CC BY · PubMed Central
Figure 2 Number of approved AI/ML-based CAD devices in the USA and Japan.
Figure 2 Number of approved AI/ML-based CAD devices in the USA and Japan.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 29 references

Cited by

See all 25

Metadata

Authors
Yuba, M., & Iwasaki, K.
Affiliations
Waseda University (JP)
Corresponding author
Iwasaki, Kiyotaka
Venue
Scientific Reports
Published
2022-10-07
Volume
12
Issue
1
Pages
16874-16874
ISSN
2045-2322 (ISSN-L)
OpenAlex
W4303432955
Cited by
25
References
29
Citations by year
2026: 7 · 2025: 7 · 2024: 6 · 2023: 5
FWCI
1.36
Type
journal article
Language
en
Open access
Licence
Locations
  • Scientific Reports (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
Waseda University
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
  • Physical Sciences › Computer Science › Artificial Intelligence › AI in cancer detection
Keywords
computer-aided detection, regulatory approval, FDA, pyromellitic dianhydride, clinical trial design, colorectal polyp detection, cross-national comparison, evaluation criteria, international standardization
MeSH terms
Machine Learning, Artificial Intelligence, Pharmaceutical Preparations, Japan, Prospective Studies, Triage

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Systematic analysis of the test design and performance of AI/ML-based medical devices approved for triage/detection/diagnosis in the USA and Japan. https://app.cochat.ai/papers/10.1038/s41598-022-21426-7
The paper
Yuba, M., & Iwasaki, K. (2022). Systematic analysis of the test design and performance of AI/ML-based medical devices approved for triage/detection/diagnosis in the USA and Japan. Scientific Reports. https://doi.org/10.1038/s41598-022-21426-7

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.