Cited by 22Electronic Health Records SystemsMachine Learning in HealthcareArtificial Intelligence in Healthcare and Education

ACE: the Advanced Cohort Engine for searching longitudinal patient records

Open access
Callahan, Alison, Polony, Vladimir, Posada, José D, Banda, Juan M, Gombar, Saurabh, Shah, Nigam H·2021·Journal of the American Medical Informatics Association

Abstract

Objective: To propose a paradigm for a scalable time-aware clinical data search, and to describe the design, implementation and use of a search engine realizing this paradigm. Materials and Methods: The Advanced Cohort Engine (ACE) uses a temporal query language and in-memory datastore of patient objects to provide a fast, scalable, and expressive time-aware search. ACE accepts data in the Observational Medicine Outcomes Partnership Common Data Model, and is configurable to balance performance with compute cost. ACE’s temporal query language supports automatic query expansion using clinical knowledge graphs. The ACE API can be used with R, Python, Java, HTTP, and a Web UI. Results: ACE offers an expressive query language for complex temporal search across many clinical data types with multiple output options. ACE enables electronic phenotyping and cohort-building with subsecond response times in searching the data of millions of patients for a variety of use cases. Discussion: ACE enables fast, time-aware search using a patient object-centric datastore, thereby overcoming many technical and design shortcomings of relational algebra-based querying. Integrating electronic phenotype development with cohort-building enables a variety of high-value uses for a learning health system. Tradeoffs include the need to learn a new query language and the technical setup burden. Conclusion: ACE is a tool that combines a unique query language for time-aware search of longitudinal patient records with a patient object datastore for rapid electronic phenotyping, cohort extraction, and exploratory data analyses.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/jamia/ocab027

Cites

82 of 82 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 4

  1. [7]Li P, Yates SN, Lovely JK, et al Patient-like-mine: a real time, visual analytics tool for clinical decision support. In: proceedings of the 2015 IEEE International Conference on Big Data (Big Data); October 29–November 1, 2015; Santa Clara.
  2. [35]Fries JA, Steinberg E, Khattar S, et al Trove: Ontology-driven weak supervision for medical entity classification. ArXiv. https://www.ncbi.nlm.nih.gov/pubmed/32793768Accessed August 5, 2020
  3. [73]Institute of Medicine (US) Roundtable on Value & Science-Driven Health Care. Clinical Data as the Basic Staple of Health Learning: Creating and Protecting a Public Good. Washington, DC: National Academies Press; 2010. 21595112
  4. [77]Boericke K, Gwinn B. Planned to perfection. Int Clin Trials 2010; 17: 26– 30.

Cited by

Sorted by citations

Authors
Callahan, A., Polony, V., Posada, J. D., Banda, J. M., Gombar, S., & Shah, N. H.
Affiliations
  • Stanford Medicine (US)
  • Center for Biomedical Informatics Research, School of Medicine, School of Medicine, Stanford University, Stanford, California, USA
  • Georgia State University (US)
Corresponding author
Callahan, Alison
Venue
Journal of the American Medical Informatics Association
Published
2021-03-13
Volume
28
Issue
7
Pages
1468-1479
ISSN
  • 1067-5027 (ISSN-L)
  • 1527-974X
OpenAlex
W3135467054
Cited by
22
References
82
Citations by year
2026: 1 · 2025: 3 · 2024: 3 · 2023: 5 · 2022: 8 · 2021: 2
FWCI
3.92
Type
journal article
Language
en
Open access
Locations
  • Journal of the American Medical Informatics Association (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
National Institutes of Health (R01LM011369-06)
Topics
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning in Healthcare
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
Keywords
temporal query languages, longitudinal patient records, electronic phenotyping, clinical knowledge graphs, query expansion, learning health systems
MeSH terms
Humans, Medical Records, Search Engine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review