Cited by 134Electronic Health Records SystemsBiomedical Text Mining and OntologiesMedical Coding and Health Information

The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.

CogStack - experiences of deploying integrated information retrieval and extraction services in a large National Health Service Foundation Trust hospital

Open access

Jackson, Richard, Kartoglu, Ismail, Stringer, Clive, Gorrell, Genevieve, Roberts, Angus, Song, Xingyi, Wu, Honghan, Agrawal, Asha, Lui, Kenneth, Groza, Tudor, Lewsley, Damian, Northwood, Doug, Folarin, Amos, Stewart, Robert, Dobson, Richard·2018·BMC Medical Informatics and Decision Making

DOI 10.1186/s12911-018-0623-9PMC PMC6020175

Published version of a preprint

Open this paper in CoChat — free account Open PDF

Abstract

BACKGROUND: Traditional health information systems are generally devised to support clinical data collection at the point of care. However, as the significance of the modern information economy expands in scope and permeates the healthcare domain, there is an increasing urgency for healthcare organisations to offer information systems that address the expectations of clinicians, researchers and the business intelligence community alike. Amongst other emergent requirements, the principal unmet need might be defined as the 3R principle (right data, right place, right time) to address deficiencies in organisational data flow while retaining the strict information governance policies that apply within the UK National Health Service (NHS). Here, we describe our work on creating and deploying a low cost structured and unstructured information retrieval and extraction architecture within King's College Hospital, the management of governance concerns and the associated use cases and cost saving opportunities that such components present. RESULTS: To date, our CogStack architecture has processed over 300 million lines of clinical data, making it available for internal service improvement projects at King's College London. On generated data designed to simulate real world clinical text, our de-identification algorithm achieved up to 94% precision and up to 96% recall. CONCLUSION: We describe a toolkit which we feel is of huge value to the UK (and beyond) healthcare community. It is the only open source, easily deployable solution designed for the UK healthcare environment, in a landscape populated by expensive proprietary systems. Solutions such as these provide a crucial foundation for the genomic revolution in medicine.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1186/s12911-018-0623-9

Cites

39 of 39 references verified0 citation errors · 0 not checkable

Statistics

Fig. 1 CogStack Architecture and Dataflow All components can be deployed via the Docker containerisation software. 1. New job execution Master instance of CogStack identifies new data in Trust Data Sources at intermittent intervals. 2. Partitioning The job is partitioned into a user definable number of work units. 3a. Derive the freetext content Extract plain and/or formatted text from common proprietary document binary formats (performing OCR where necessary), using the Tika Library to enable the downstream processing of high value unstructured data elements. 3b. Supplement the text content with meta-data Filter and de-normalise a subset of the structured clinical data to provide a patient orientated, transparent representation of high value metadata concepts. For example, this might include calculated fields to represent patient age at document date, first part of postcode and ethnicity and lab results. 3c. De-identification Transform the resulting text documents into de-identified text documents, by masking personal health identifiers via the use of the Cognition de-identification algorithms. This is necessary to address governance concerns associated with the secondary use of patient data. Identifiers in structured data can be excluded via SQL query, according to business requirements. 4. Information Extraction Apply generic clinical IE pipelines to derive additional structured data from free text and supplement the quantity of available structured data at the point of query. 5. Indexing Build a JSON object from the resulting structured and unstructured data, which can then be readily be indexed into an Elasticsearch cluster. 6. Visualisation The Kibana suite provides a range of attractive options for viewing, aggregating and dash-boarding the loaded dataCC BY · PubMed Central

Fig. 2 Kibana interface loaded with pseudo-dataCC BY · PubMed Central

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

MIMIC-III, a freely accessible critical care database
Johnson, A. E. W., Pollard, T. J., Shen, L., Lehman, L.-W. H., Feng, M., Ghassemi, M., Moody, B., Szolovits, P., Anthony Celi, L., & Mark, R. G. (2016) · Scientific Data · doi:10.1038/sdata.2016.35 · Cited by 8,141
The unified medical language system (UMLS): integrating biomedical terminology
Bodenreider, O. (2004) · Nucleic Acids Research · doi:10.1093/nar/gkh061 · Cited by 4,356
An Overview of the Tesseract OCR Engine
Smith, R. W. (2007) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2007.4376991 · Cited by 2,457
Studies in Health Technology and Informatics
Aphinyanaphongs, Y., & Aliferis, C. (2007) · Cited by 1,247
A Simple Algorithm for Identifying Negated Findings and Diseases in Discharge Summaries
Chapman, W. W., Bridewell, W. B., Hanbury, P., Cooper, G. F., & Buchanan, B. G. (2001) · Journal of Biomedical Informatics · doi:10.1006/jbin.2001.1029 · Cited by 1,121
The Human Phenotype Ontology project: linking molecular biology and disease through phenotype data
Köhler, S., Doelken, S., Mungall, C. J., Bauer, S., Firth, H., Bailleul-Forestier, I., Black, G., Brown, D. L., Brudno, M., Campbell, J., et al. (2013) · Nucleic Acids Res. · doi:10.1093/nar/gkt1026 · Cited by 840
Cohort profile of the South London and Maudsley NHS Foundation Trust Biomedical Research Centre (SLaM BRC) Case Register: current status and recent enhancement of an Electronic Mental Health Record-derived data resource
Perera, G., Broadbent, M. T. M., Callard, F. J., Chang, C., Downs, J. M., Dutta, R., Fernandes, A. C., Hayes, R. D., Henderson, M., Jackson, R., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-008721 · Cited by 492
Self-citation
The South London and Maudsley NHS Foundation Trust Biomedical Research Centre (SLAM BRC) case register: development and descriptive data.
Stewart, R., Soremekun, M., Perera, G., Broadbent, M., Callard, F., Denis, M., Hotopf, M., Thornicroft, G., & Lovestone, S. (2009) · BMC Psychiatry · doi:10.1186/1471-244x-9-51 · Cited by 445
Self-citation
Automated de-identification of free-text medical records
Neamatullah, I., Douglass, M. M., Lehman, L.-W. H., Reisner, A., Villarroel, M., Long, W. J., Szolovits, P., Moody, G. B., Mark, R. G., & Clifford, G. D. (2008) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-8-32 · Cited by 413
Secondary Use of EHR: Data Quality Issues and Informatics Opportunities.
(2010) · PubMed Central · Cited by 332

Show all 39 references

Research works printed but not linked: 1

Jackson R, Kartoglu I. A Open Pipeline for Masking Patient Identifiers in Electronic Health Records, The Farr Institute International Conference 2015. 2015.

Sorted by citations

Multidisciplinary research priorities for the COVID-19 pandemic: a call for action for mental health science
Holmes, E. A., O'Connor, R. C., Perry, V. H., Tracey, I., Wessely, S., Arseneault, L., Ballard, C., Christensen, H., Cohen Silver, R., Everall, I., et al. (2020) · The Lancet Psychiatry · doi:10.1016/s2215-0366(20)30168-1 · Cited by 5,715
Natural language processing in medicine: A review
Locke, S., Bashall, A., Al-Adely, S., Moore, J., Wilson, A. J., & Kitchen, G. B. (2021) · Trends in Anaesthesia and Critical Care · doi:10.1016/j.tacc.2021.02.007 · Cited by 270
Angiotensin-Converting Enzyme Inhibitors and Angiotensin II Receptor Blockers are Not Associated with Severe COVID-19 Infection in a Multi-Site UK Acute Hospital Trust
Bean, D. M., Kraljević, Ž., Searle, T., Bendayan, R., O’Gallagher, K., Pickles, A. R., Folarin, A., Roguski, Ł., Noor, K., Shek, A., et al. (2020) · European Journal of Heart Failure · doi:10.1002/ejhf.1924 · Cited by 231
Self-citation
UK phenomics platform for developing and validating electronic health record phenotypes: CALIBER
Denaxas, S., González-Izquierdo, A., Direk, K., Fitzpatrick, N. K., Fatemifar, G., Banerjee, A., Dobson, R., Howe, L. J., Kuan, V., Lumbers, R. T., et al. (2019) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocz105 · Cited by 219
Self-citation
Multi-domain clinical natural language processing with MedCAT: The Medical Concept Annotation Toolkit
Kraljević, Ž., Searle, T., Shek, A., Roguski, Ł., Noor, K., Bean, D. M., Mascio, A., Zhu, L., Folarin, A., Roberts, A., et al. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102083 · Cited by 255
Self-citation
Natural Language Processing
Fanni, S. C., Febi, M., Aghakhanyan, G., & Neri, E. (2023) · Imaging informatics for healthcare professionals · doi:10.1007/978-3-031-25928-9_5 · Cited by 182
Harnessing Big Data Analytics for Healthcare: A Comprehensive Review of Frameworks, Implications, Applications, and Impacts
Ahmed, A., Xi, R., Hou, M., Shah, S. A., & Hameed, S. (2023) · IEEE Access · doi:10.1109/access.2023.3323574 · Cited by 164
Evaluation and improvement of the National Early Warning Score (NEWS2) for COVID-19: a multi-hospital study
Carr, E., Bendayan, R., Bean, D. M., Stammers, M., Wang, W., Zhang, H., Searle, T., Kraljević, Ž., Shek, A., Phan, H. T. T., et al. (2021) · BMC Medicine · doi:10.1186/s12916-020-01893-3 · Cited by 139
Self-citation
Artificial Intelligence in Clinical Decision Support: a Focused Literature Survey
Stefania Montani, B., & Striani, M. (2019) · Yearbook of Medical Informatics · doi:10.1055/s-0039-1677911 · Cited by 138
SemEHR: A general-purpose semantic search system to surface semantic data from clinical notes for tailored care, trial recruitment, and clinical research*
Wu, H., Toti, G., Morley, K. I., Ibrahim, Z. M., Folarin, A., Jackson, R., Kartoglu, I. E., Agrawal, A., Stringer, C., Gale, D., et al. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocx160 · Cited by 123
Self-citation
Foresight-a generative pretrained transformer for modelling of patient timelines using electronic health records: a retrospective modelling study
Kraljevic, Z., Bean, D., Shek, A., Bendayan, R., Hemingway, H., Yeung, J. A., Deng, A., Balston, A., Ross, J., Idowu, E., et al. (2024) · The Lancet Digital Health · doi:10.1016/s2589-7500(24)00025-6 · Cited by 169
Self-citation
A survey on clinical natural language processing in the United Kingdom from 2007 to 2022
Wu, H., Wang, M., Wu, J., Francis, F., Chang, Y.-H., Shavick, A., Dong, H., Poon, M. T. C., Fitzpatrick, N., Levine, A. P., et al. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00730-6 · Cited by 101
Self-citation
Artificial intelligence for dementia—Applied models and digital health
Lyall, D. M., Kormilitzin, A., Lancaster, C. L., Sousa, J., Petermann-Rocha, F. E., Buckley, C., Harshfield, E. L., Iveson, M. H., Madan, C. R., Ardle, R. M., et al. (2023) · Alzheimer s & Dementia · doi:10.1002/alz.13391 · Cited by 74
Best practices in the real-world data life cycle
Zhang, J., Symons, J., Agapow, P., Teo, J., Paxton, C. A., Abdi, J., Mattie, H., Davie, C., Torres, A. Z., Folarin, A., et al. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000003 · Cited by 72
Self-citation
Current and Future Advances in Surgical Therapy for Pituitary Adenoma
Khan, D. Z., HANRAHAN, J. G., Baldeweg, S. E., Dorward, N., Stoyanov, D. V., & Marcus, H. J. (2023) · Endocrine Reviews · doi:10.1210/endrev/bnad014 · Cited by 71
Should free-text data in electronic medical records be shared for research? A citizens’ jury study in the UK
Ford, E., Oswald, M., Hassan, L., Bozentko, K., Nenadic, G., & Cassell, J. (2020) · Journal of Medical Ethics · doi:10.1136/medethics-2019-105472 · Cited by 59
Natural Language Processing for Mimicking Clinical Trial Recruitment in Critical Care: A Semi-Automated Simulation Based on the LeoPARDS Trial
Tissot, H. C., Shah, A. D., Brealey, D., Harris, S., Agbakoba, R., Folarin, A., Romao, L., Roguski, L., Dobson, R., & Asselbergs, F. W. (2020) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.2977925 · Cited by 61
Self-citation
Role and Challenges of Unstructured Big Data in Healthcare
Adnan, K., Akbar, R., Khor, S. W., & Ali, A. B. A. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-981-32-9949-8_22 · Cited by 60
A case-control and cohort study to determine the relationship between ethnic background and severe COVID-19
Zakeri, R., Bendayan, R., Ashworth, M. J., Bean, D. M., Dodhia, H., Durbaba, S., O’Gallagher, K., Palmer, C., Ćurčin, V., Aitken, E., et al. (2020) · EClinicalMedicine · doi:10.1016/j.eclinm.2020.100574 · Cited by 59
Self-citation
Artificial Intelligence Methods for Improved Detection of Undiagnosed Heart Failure with Preserved Ejection Fraction
Wu, J., Biswas, D., Ryan, M. J., Bernstein, B. S., Rizvi, M., Fairhurst, N., Kaye, G., Baral, R., Searle, T., Melikian, N., et al. (2023) · European Journal of Heart Failure · doi:10.1002/ejhf.3115 · Cited by 59
Self-citation
Discharge summary hospital course summarisation of in patient Electronic Health Record text with clinical concept guided deep pre-trained Transformer models
Searle, T., Ibrahim, Z. M., Teo, J., & Dobson, R. (2023) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2023.104358 · Cited by 62
Self-citation
Evaluation and Improvement of the National Early Warning Score (NEWS2) for COVID-19: a multi-hospital studyPreprint
Carr, E., Bendayan, R., Bean, D. M., Stammers, M., Wang, W., Zhang, H., Searle, T., Kraljević, Ž., Shek, A., Phan, H. T. T., et al. (2020) · medRxiv · doi:10.1101/2020.04.24.20078006 · Cited by 43
Self-citation
Pre-existing cardiovascular disease rather than cardiovascular risk factors drives mortality in COVID-19
O’Gallagher, K., Shek, A., Bean, D. M., Bendayan, R., Papachristidis, A., Teo, J., Dobson, R., Shah, A. M., & Zakeri, R. (2021) · BMC Cardiovascular Disorders · doi:10.1186/s12872-021-02137-9 · Cited by 41
Self-citation
Clinical Information Retrieval: A Literature Review
Sivarajkumar, S., Mohammad, H. A., Oniani, D., Roberts, K. E., Hersh, W., Liu, H., He, D., Visweswaran, S., & Wang, Y. (2024) · Journal of Healthcare Informatics Research · doi:10.1007/s41666-024-00159-4 · Cited by 41
Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Wang, T., Oliver, D., Msosa, Y. J., Colling, C., Spada, G., Roguski, Ł., Folarin, A., Stewart, R. J., Roberts, A., Dobson, R., et al. (2020) · Journal of Visualized Experiments · doi:10.3791/60794 · Cited by 36
Self-citation
MedCATTrainer: A Biomedical Free Text Annotation Interface with Active Learning and Research Use Case Specific Customisation
Searle, T., Kraljević, Ž., Bendayan, R., Bean, D. M., & Dobson, R. (2019) · Conference on Empirical Methods in Natural Language Processing: System Demonstrations (EMNLP) · doi:10.18653/v1/d19-3024 · Cited by 35
Self-citation
Bleeding in cardiac patients prescribed antithrombotic drugs: electronic health record phenotyping algorithms, incidence, trends and prognosis
Pasea, L., Chung, S., Pujades‐Rodríguez, M., Shah, A. D., Alvarez‐Madrazo, S., Allan, V., Teo, J., Bean, D. M., Sofat, R., Dobson, R., et al. (2019) · BMC Medicine · doi:10.1186/s12916-019-1438-y · Cited by 32
Self-citation
Trustworthy Data and AI Environments for Clinical Prediction: Application to Crisis-Risk in People With Depression
Msosa, Y. J., Grauslys, A., Zhou, Y., Wang, T., Buchan, I. E., Langan, P., Foster, S., Walker, M., Pearson, M. G., Folarin, A., et al. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3312011 · Cited by 29
Self-citation
MedGPT: Medical Concept Prediction from Clinical NarrativesPreprint
Kraljević, Ž., Shek, A., Bean, D. M., Bendayan, R., Teo, J., & Dobson, R. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2107.03134 · Cited by 62
Self-citation
Advancement in public health through machine learning: a narrative review of opportunities and ethical considerations
Dhanda, S. S., Panwar, D., Lin, C., Sharma, T. K., Rastogi, D., Bindewari, S., Singh, A. M., Li, Y., Agarwal, N. K., & Agarwal, S. (2025) · Journal Of Big Data · doi:10.1186/s40537-025-01201-x · Cited by 35
What can we learn from 68 000 clinical frailty scale scores? Evaluating the utility of frailty assessment in emergency departments
Ellis, H. L., Dunnell, L., Eyres, R., Whitney, J. C., Jennings, C., Wilson, D., Tippett, J., Stein, D. F., Teo, J., Ibrahim, Z. M., et al. (2025) · Age and Ageing · doi:10.1093/ageing/afaf093 · Cited by 26
Deployment of a Free-Text Analytics Platform at a UK National Health Service Research Hospital: CogStack at University College London Hospitals
Noor, K., Roguski, Ł., Bai, X., Handy, Á., Klapaukh, R., Folarin, A., Romão, L., Matteson, J., Lea, N., Zhu, L., et al. (2022) · JMIR Medical Informatics · doi:10.2196/38122 · Cited by 24
Self-citation
Semantic computational analysis of anticoagulation use in atrial fibrillation from real world data
Bean, D. M., Teo, J., Wu, H., Oliveira, R., Patel, R., Bendayan, R., Shah, A. M., Dobson, R., & Scott, P. A. (2019) · PLoS ONE · doi:10.1371/journal.pone.0225625 · Cited by 23
Self-citation
Natural Language Processing in Spine Surgery: A Systematic Review of Applications, Bias, and Reporting Transparency
Huang, B. B., Huang, J., & Swong, K. N. (2022) · World Neurosurgery · doi:10.1016/j.wneu.2022.08.109 · Cited by 26
Toward the Development of Data Governance Standards for Using Clinical Free-Text Data in Health Research: Position Paper
Jones, K. H., Ford, E. M., Lea, N., Griffiths, L. J., Hassan, L., Heys, S., Squires, E., & Nenadić, G. (2020) · Journal of Medical Internet Research · doi:10.2196/16760 · Cited by 23
Hospital-wide natural language processing summarising the health data of 1 million patients
Bean, D. M., Kraljevic, Z., Shek, A., Teo, J., & Dobson, R. J. B. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000218 · Cited by 22
Self-citation
Predicting fracture outcomes from clinical registry data using artificial intelligence supplemented models for evidence-informed treatment (PRAISE) study protocol
Dipnall, J. F., Page, R. S., Du, L., Costa, M. L., Lyons, R. A., Cameron, P. A., de Steiger, R. N., Hau, R., Bucknill, A., Oppy, A., et al. (2021) · PLoS ONE · doi:10.1371/journal.pone.0257361 · Cited by 23
Diagnostic yield and limitations of in‐hospital documentation in patients with epilepsy
Schulze‐Bonhage, A., Bruno, E., Brandt, A., Shek, A., Viana, P. F., Heers, M., Martinez‐Lizana, E., Altenmüller, D., Richardson, M. P., & Antonio‐Arce, V. S. (2022) · Epilepsia · doi:10.1111/epi.17307 · Cited by 22
Developing a linked electronic health record derived data platform to support research into healthy ageing
Andrew, N. E., Beare, R. J., Ravipati, T., Parker, E. A., Snowdon, D. A., Naude, K., & Srikanth, V. K. (2023) · International Journal for Population Data Science · doi:10.23889/ijpds.v8i1.2129 · Cited by 22
A fast, accurate, and generalisable heuristic-based negation detection algorithm for clinical text
Slater, L. T., Bradlow, W. M., Motti, D. F., Hoehndorf, R., Ball, S. T., & Gkoutos, G. V. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104216 · Cited by 19
Estimating redundancy in clinical text
Searle, T., Ibrahim, Z. M., Teo, J., & Dobson, R. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103938 · Cited by 25
Self-citation
Diagnostic signature for heart failure with preserved ejection fraction (HFpEF): a machine learning approach using multi-modality electronic health record data
Farajidavar, N., O’Gallagher, K., Bean, D. M., Nabeebaccus, A., Zakeri, R., Bromage, D. I., Kraljević, Ž., Teo, J., Dobson, R., & Shah, A. M. (2022) · BMC Cardiovascular Disorders · doi:10.1186/s12872-022-03005-w · Cited by 18
Self-citation
Negation detection in Dutch clinical texts: an evaluation of rule-based and machine learning methods
van Es, B., Reteig, L. C., Tan, S., Schraagen, M., Hemker, M. M., Arends, S. R. S., Rios, M., & Haitjema, S. (2023) · BMC Bioinformatics · doi:10.1186/s12859-022-05130-x · Cited by 25
Development of Usability Enhancement Model for Unstructured Big Data Using SLR
Adnan, K., Akbar, R., & Wang, K. S. (2021) · IEEE Access · doi:10.1109/access.2021.3089100 · Cited by 21
Prognostic relevance of demographic factors in cardiac magnetic resonance-proven acute myocarditis: A cohort study
Cannata, A. N., Bhatti, P., Roy, R., Al-Agil, M., Daniel, A., Ferone, E., Jordan, A., Cassimon, B., Bradwell, S. B., Khawaja, A., et al. (2022) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2022.1037837 · Cited by 17
Potential application of artificial intelligence in cancer therapy
Riaz, I. B., Khan, M. A., & Haddad, T. C. (2024) · Current Opinion in Oncology · doi:10.1097/cco.0000000000001068 · Cited by 19
A National Network of Safe Havens: Scottish Perspective
Gao, C., McGilchrist, M. M., Mumtaz, S., Hall, C., Anderson, L. A., Zurowski, J., Gordon, S., Lumsden, J., Munro, V., Wozniak, A., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/31684 · Cited by 18
Biological Responses to COVID-19 Insights from Physiological and Blood Biomarker Profiles
Zakeri, R., Pickles, A. R., Carr, E., Bean, D. M., O’Gallagher, K., Kraljević, Ž., Searle, T., Shek, A., Galloway, J. B., Teo, J., et al. (2020) · Current Research in Translational Medicine · doi:10.1016/j.retram.2021.103276 · Cited by 15
Self-citation
Diagnostic accuracy, clinical characteristics, and prognostic differences of patients with acute myocarditis according to inclusion criteria
Roy, R., Cannata, A. N., Al-Agil, M., Ferone, E., Jordan, A., To-Dang, B., Sadler, M., Shamsi, A., Albarjas, M., Piper, S. E., et al. (2023) · European Heart Journal - Quality of Care and Clinical Outcomes · doi:10.1093/ehjqcco/qcad061 · Cited by 18
UK phenomics platform for developing and validating EHR phenotypes: CALIBERPreprint
Denaxas, S., González-Izquierdo, A., Direk, K., Fitzpatrick, N. K., Banerjee, A., Dobson, R., Fatemifar, G., Kuan, V., Lumbers, R. T., Pasea, L., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/539403 · Cited by 15
Self-citation
Komenti: A semantic text mining frameworkPreprint
Slater, L. T., Bradlow, W. M., Hoehndorf, R., Motti, D. F., Ball, S. T., & Gkoutos, G. V. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.08.04.233049 · Cited by 14
What is the patient re-identification risk from using de-identified clinical free text data for health research?
Ford, E. M., Pillinger, S., Stewart, R. J., Jones, K. H., Roberts, A., Casey, A., Goddard, K., & Nenadić, G. (2025) · AI and Ethics · doi:10.1007/s43681-025-00681-0 · Cited by 19
Self-citation
Developing automated methods for disease subtyping in UK Biobank: an exemplar study on stroke
Rannikmäe, K., Wu, H., Tominey, S., Whiteley, W. N., Allen, N. E., Sudlow, C. L. M., & Biobank, T. U. (2021) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-021-01556-0 · Cited by 13
Self-citation
A Blood Test for Alzheimer's Disease: Progress, Challenges, and Recommendations
Kiddle, S. J., Voyle, N., & Dobson, R. (2018) · UCL Discovery (University College London) · Cited by 12
Self-citation
An implementation framework and a feasibility evaluation of a clinical decision support system for diabetes management in secondary mental healthcare using CogStack
Patel, D., Msosa, Y. J., Wang, T., Mustafa, O. G., Gee, S., Williams, J., Roberts, A., Dobson, R., & Gaughran, F. (2022) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-022-01842-5 · Cited by 12
Self-citation
Application of specialized word embeddings and named entity and attribute recognition to the problem of unsupervised automated clinical coding
Nath, N., Lee, S., & Lee, I. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107422 · Cited by 11
Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Wang, T., Oliver, D., Msosa, Y. J., Colling, C., Spada, G., Roguski, Ł., Folarin, A., Stewart, R. J., Roberts, A., Dobson, R., et al. (2020) · Journal of Visualized Experiments · doi:10.3791/60794-v · Cited by 11
Self-citation
VIEWER: an extensible visual analytics framework for enhancing mental healthcare
Wang, T., Codling, D., Msosa, Y. J., Broadbent, M. T. M., Kornblum, D., Polling, C., Searle, T., Delaney-Pope, C., Arroyo, B., MacLellan, S., et al. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf010 · Cited by 9
Self-citation
Real-time clinician text feeds from electronic health records
Teo, J., Dinu, V., Bernal, W. E., Davidson, P., Oliynyk, V., Breen, C. P., Barker, R. D., & Dobson, R. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00406-7 · Cited by 9
Self-citation
Streams, rivers and data lakes: an introduction to understanding modern electronic healthcare records
Idowu, E., Teo, J., Salih, S., Valverde, J., & Yeung, J. A. (2023) · Clinical Medicine · doi:10.7861/clinmed.2022-0325 · Cited by 10
Validating Transformers for Redaction of Text from Electronic Health Records in Real-World Healthcare
Kraljević, Ž., Shek, A., Yeung, J. A., Sheldon, E. J., Shuaib, H., Al-Agil, M., Bai, X., Noor, K., Shah, A. D., Dobson, R., et al. (2023) · IEEE International Conference on Healthcare Informatics (ICHI) · doi:10.1109/ichi57859.2023.00098 · Cited by 11
Self-citation
Generating high-quality data abstractions from scanned clinical records: text-mining-assisted extraction of endometrial carcinoma pathology features as proof of principle
Nguyen, A. N., O'Dwyer, J., Vu, T., Webb, P. M., Johnatty, S. E., & Spurdle, A. B. (2020) · BMJ Open · doi:10.1136/bmjopen-2020-037740 · Cited by 9
A framework for de-identification of free-text data in electronic medical records enabling secondary use
Mercorelli, L. R., Nguyen, H. H., Gartell, N., Brookes, M., Morris, J. M., & Tam, C. S. (2022) · Australian Health Review · doi:10.1071/ah21361 · Cited by 9
Racial and ethnic disparities in aortic stenosis within a universal healthcare system characterized by natural language processing for targeted intervention
Biswas, D., Wu, J., Brown, S., Bharucha, A. H., Fairhurst, N., Kaye, G., Jones, K., Copeland, F. P., O’Donnell, B., Kyle, D., et al. (2025) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztaf018 · Cited by 8
Self-citation
Learning Health Systems provide a glide path to safe landing for AI in health
Ćurčin, V., Delaney, B. C., Alkhatib, A., Cockburn, N., Dann, O., Kostopoulou, O., Leightley, D., Maddocks, M., Modgil, S., Nirantharakumar, K., et al. (2025) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2025.103346 · Cited by 13
Natural language word embeddings as a glimpse into healthcare language and associated mortality surrounding end of life
Lau, I. S., Kraljević, Ž., Al-Agil, M., Charing, S., Quarterman, A., Parkes, H., Metaxa, V., Sleeman, K. E., Gao, W., Dobson, R., et al. (2021) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2021-100464 · Cited by 8
Self-citation
Ethnic variations in neutrophil count as predictors of prognosis following acute myocardial infarction
Sadler, M., Cannata, A. N., Mackie, S., Anandhakrishna, R. M., Argunhan, F., Ferone, E., Al-Agil, M., Salim, J., Tantichirasakul, N., Lam, M. T., et al. (2025) · Atherosclerosis · doi:10.1016/j.atherosclerosis.2025.119169 · Cited by 7
Large-Scale Knowledge Synthesis and Complex Information Retrieval from Biomedical Documents
Saxena, S., Sangani, R., Prasad, S., Kumar, S., Athale, M., Awhad, R., & Vaddina, V. (2022) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata55660.2022.10020725 · Cited by 6
Natural Language Processing to Extract Head and Neck Cancer Data From Unstructured Electronic Health Records
Young, T., Yeung, J. A., Sambasivan, K., Adjogatse, D., Kong, A. H., Petkar, I., Ferreira, M. R., Lei, M., King, A. P., Teo, J., et al. (2025) · Clinical Oncology · doi:10.1016/j.clon.2025.103805 · Cited by 6
national initiative in data science for health: an evaluation of the UK Farr Institute
Hemingway, H., Lyons, R. A., Li, Q., Buchan, I. E., Ainsworth, J. D., Pell, J. P., & Morris, A. D. (2020) · International Journal for Population Data Science · doi:10.23889/ijpds.v5i1.1128 · Cited by 6
Artificial intelligence methods to detect heart failure with preserved ejection fraction within electronic health records: an equitable disease detection model
Wu, J., Biswas, D., Brown, S., Ryan, M., Bernstein, B. S., To, B. T., Searle, T., Rizvi, M., Fairhurst, N., Kaye, G., et al. (2025) · European Heart Journal - Digital Health · doi:10.1093/ehjdh/ztaf107 · Cited by 8
Self-citation
De-identification of clinical data: A systematic review of free text, image and tabular data approaches
Faustini, P., McIver, A. K., Sullivan, R., & Dras, M. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106225 · Cited by 10
Regional performance variation in external validation of four prediction models for severity of COVID-19 at hospital admission: An observational multi-centre cohort study
Wickstrøm, K. E., Vitelli, V., Carr, E., Holten, A. R., Bendayan, R., Reiner, A. H., Bean, D. M., Searle, T., Shek, A., Kraljević, Ž., et al. (2021) · PLoS ONE · doi:10.1371/journal.pone.0255748 · Cited by 5
Self-citation
Natural language processing – relevance to patient outcomes and real-world evidence
Stewart, R. J., Chaturvedi, J., & Roberts, A. (2023) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1080/14737167.2023.2275670 · Cited by 7
Self-citation
Enhancing clinical data retrieval with Smart Watchers: a NiFi-based ETL pipeline for Elasticsearch queries
Al-Agil, M., Obee, S. J., Dinu, V., Teo, J., Brawand, D., Patten, P., & Alhaq, A. (2024) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-024-02633-w · Cited by 4
SearchEHR
Dai, X., Rybinski, M., & Karimi, S. (2021) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/3459637.3481986 · Cited by 4
Utilising Natural Language Processing to Identify Brain Tumor Patients for Clinical Trials: Development and Initial Evaluation
Booker, J., Penn, J., Noor, K., Dobson, R., Fersht, N. L., Funnell, J. P., Hill, C. S., Khan, D. Z., Newall, N., Searle, T., et al. (2025) · World Neurosurgery · doi:10.1016/j.wneu.2025.123907 · Cited by 6
Self-citation
Business intelligence tools to optimize the appropriateness of the diagnostic process for clinical and epidemiologic purposes in a multicenter veterinary pathology service
Pozzato, N., D’Este, L., Gagliazzo, L., Vascellari, M., Cocchi, M., Agnoletti, F., Bano, L., Barberio, A., Dellamaria, D., Gobbo, F., et al. (2021) · Journal of Veterinary Diagnostic Investigation · doi:10.1177/10406387211003163 · Cited by 4
Impact of direct-access IBD physician delivered endoscopy on clinical outcomes: a pre-implementation and post-implementation study
Stammers, M., Rahmany, S., Downey, L., Borca, F., Harris, C., Harris, R. J., McDonnell, M., Sartain, S., Coleman, N., Stacey, B., et al. (2022) · Frontline Gastroenterology · doi:10.1136/flgastro-2021-102047 · Cited by 4
Machine learning outcome prediction using stress perfusion cardiac magnetic resonance reports and natural language processing of electronic health records
Alskaf, E., Frey, S., Scannell, C. M., Suinesiaputra, A., Vilić, D., Dinu, V., Masci, P. G., Perera, D., Young, A. A., & Chiribiri, A. (2023) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2023.101418 · Cited by 5
In response to Ballantyne and Schaefer’s ‘Consent and the ethical duty to participate in health data research’
Hepgul, N., Sleeman, K. E., Firth, A. M., Johnston, A., Teo, J., Bernal, W. E., Dobson, R., & Higginson, I. J. (2019) · Journal of Medical Ethics · doi:10.1136/medethics-2018-105271 · Cited by 4
Self-citation
The Australian and New Zealand Massive Transfusion Registry: An innovation focusing on data collection, standardisation and interoperability between healthcare systems
Sparrow, R. L., Haysom, H. E., Loh, J., Caithness, K., Mandapaka, K., Wellard, C. J., McQuilten, Z., & Wood, E. M. (2025) · Health Information Management Journal · doi:10.1177/18333583251375121 · Cited by 3
Early evaluation of a natural language processing tool to improve access to educational resources for surgical patients
Booker, J., Penn, J., Noor, K., Dobson, R., Funnell, J. P., Koh, C. H., Khan, D. Z., Newall, N., Rowland, D., Sinha, S., et al. (2024) · European Spine Journal · doi:10.1007/s00586-024-08315-5 · Cited by 3
Self-citation
Developing clinical informatics to support direct care and population health management: the VIEWER story
Harland, R., Wang, T., Codling, D., Polling, C., Broadbent, M. T. M., Newton, H., Msosa, Y. J., Kornblum, D., Delaney-Pope, C., Arroyo, B., et al. (2025) · BMJ Health & Care Informatics · doi:10.1136/bmjhci-2025-101530 · Cited by 3
Self-citation
Key issues for a manufacturing data query system based on graph
Kim, L., Yahia, E., Segonds, F., Véron, P., & Fau, V. (2021) · International Journal on Interactive Design and Manufacturing (IJIDeM) · doi:10.1007/s12008-021-00768-y · Cited by 3
Revolutionizing Healthcare: Convergence of IoT and Open-Source ERP Systems in Health Information Management
Alihamidi, I., Deroussi, A., Addaim, A., & Madi, A. A. (2024) · International Journal of Online and Biomedical Engineering (iJOE) · doi:10.3991/ijoe.v20i09.48805 · Cited by 3
Countries’ experiences in reforming hospital administration structure based on the Parker and Harding model: A systematic review study
Tabrizi, J. S., Aghdash, S. A., & Nouri, M. (2021) · Journal of Education and Health Promotion · doi:10.4103/jehp.jehp_1649_20 · Cited by 3
Text Mining in Healthcare: Bringing Structure to Electronic Health Records
Bagheri, A. (2021) · Utrecht University Repository (Utrecht University) · doi:10.33540/531 · Cited by 3
Dual‐stream algorithms for dementia detection: Harnessing structured and unstructured electronic health record data, a novel approach to prevalence estimation
Collyer, T. A., Liu, M., Beare, R. J., Andrew, N. E., Ung, D., Carver, A., Ilomäki, J., Bell, J. S., Thrift, A. G., Rocca, W. A., et al. (2025) · Alzheimer s & Dementia · doi:10.1002/alz.70132 · Cited by 2
Improving personalized healthcare with automated longitudinal EHR analysis
Pal, G. (2025) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2025.106010 · Cited by 2
Data-centric artificial intelligence and cancer research: construction of a real-world head and neck treatment data repository
Butterworth, V., Young, T., Drake, H., Palmer, I., Avgoulea, T., Ivy, E., Andriolo, J., Creppy, C., Routledge, C., Adjogatse, D., et al. (2025) · ESMO Real World Data and Digital Oncology · doi:10.1016/j.esmorw.2025.100162 · Cited by 2
Premature mortality and disparities in kidney healthcare for people with chronic kidney disease and severe mental health difficulties
Cogley, C., Smith-Jones, M., Ralston, E., Bramham, J., Chilcot, J., D’Alton, P., Carswell, C., Lam, C. C. S. F., Ratnam, A., Al-Agil, M., et al. (2024) · Journal of Nephrology · doi:10.1007/s40620-024-02103-6 · Cited by 2
From Learning About Machines to Machine Learning: Applications for Mental Health Rehabilitation
Chaturvedi, J. (2020) · Journal of Psychosocial Rehabilitation and Mental Health · doi:10.1007/s40737-020-00163-y · Cited by 2
Anticoagulation for atrial fibrillation in people with serious mental illness in the general hospital setting
Farran, D., Bean, D. M., Wang, T., Msosa, Y. J., Casetta, C., Dobson, R., Teo, J., Scott, P. A., & Gaughran, F. (2022) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2022.06.044 · Cited by 2
Self-citation
Bleeding in cardiac patients prescribed antithrombotic drugs: Electronic health record phenotyping algorithms, incidence, trends and prognosisPreprint
Pasea, L., Chung, S., Pujades‐Rodríguez, M., Shah, A. D., Alvarez‐Madrazo, S., Allan, V., Teo, J., Bean, D. M., Sofat, R., Dobson, R., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/538249 · Cited by 2
Self-citation
SALTClass: classifying clinical short notes using background knowledge from unlabeled dataPreprint
Bagheri, A., Oberski, D. L., Sammani, A., van der Heijden, P. G. M., & Asselbergs, F. W. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/801944 · Cited by 2
Data-driven decision-making: Turning insights into action
Ribeiro, L., & O’Brien, T. (2025) · Journal of Clinical Urology · doi:10.1177/20514158251348043 · Cited by 1
A platform for generating clinical intelligence from routine health data in hospitals: PICTURE
Bowyer, S. A., Pissaridou, E., Booth, J., Key, D. A., Bryant, W. A., Sheldon, E. J., Zenonos, A., Pope, R. A., Hemingway, H., Taylor, A. M., et al. (2025) · Future Healthcare Journal · doi:10.1016/j.fhj.2025.100492 · Cited by 1
From data to knowledge: artificial intelligence methods for studying comorbidity in electronic health records
Лукьяненко, Д., Алигейдаровна, Р. А., Мухорина, А. К., Tyukina, T., & Геннадьевич, З. Д. (2026) · The European Physical Journal Special Topics · doi:10.1140/epjs/s11734-026-02571-w · Cited by 1
Risk Factors Extraction from Clinical Texts based on Linked Open Data
Boytcheva, S., Angelova, G., & Angelov, Z. (2019) · International conference Recent advances in natural language processing · doi:10.26615/978-954-452-056-4_019 · Cited by 1

Authors: Jackson, R., Kartoglu, I., Stringer, C., Gorrell, G., Roberts, A., Song, X., Wu, H., Agrawal, A., Lui, K., Groza, T., Lewsley, D., Northwood, D., Folarin, A., Stewart, R., & Dobson, R.
Affiliations: King's College London (GB)
InterDigital (United Kingdom) (GB)
Farr Institute (GB)
King's College Hospital (GB)
Garvan Institute of Medical Research (AU)
Corresponding author: Jackson, Richard
ORCID: Jackson, Richard
Roberts, Angus
Song, Xingyi
Wu, Honghan
Groza, Tudor
Folarin, Amos
Stewart, Robert
Dobson, Richard
Venue: BMC Medical Informatics and Decision Making
Publisher: Springer Science and Business Media LLC
Published: 2018-06-25
Volume: 18
Issue: 1
Pages: 47-47
ISSN: 1472-6947 (ISSN-L)
DOI: 10.1186/s12911-018-0623-9
PMC: PMC6020175
OpenAlex: W2949308662
Cited by: 134
References: 39
Citations by year: 2026: 11 · 2025: 22 · 2024: 12 · 2023: 18 · 2022: 13 · 2021: 28 · 2020: 15 · 2019: 13 · 2018: 2
FWCI: 18.29
Type: journal article
Language: en
Open access: gold
doi.org
Licence: cc-by
creativecommons.org/licenses/by/4.0/ (tdm)
Locations: BMC Medical Informatics and Decision Making (publishedVersion, cc-by)
bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
Europe PMC (PubMed Central) (publishedVersion, other-oa)
PubMed Central (publishedVersion, cc-by)
PubMed (publishedVersion)
White Rose Research Online (University of Leeds, The University of Sheffield, University of York) (acceptedVersion)
Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, public-domain)
DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
UCL Discovery (University College London) (submittedVersion)
Research Portal (King's College London) (submittedVersion, cc-by)
Funders: Wellcome Trust (MR/K006584/1)
UK Infrastructure for Large-scale Clinical Genomics Research (MC_PC_14089)
National Institute for Health Research (NIHR) Biomedical Research Centre at South London and Maudsley NHS Foundation Trust
National Institute for Health Research (NIHR) Biomedical Research Centre at University College London Hospital
NHS England Enablement
Horizon 2020 Framework Programme (644753)
Topics: Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
Keywords: medical information retrieval, clinical text extraction, health information systems, National Health Service, information governance, de-identification, medical data processing, open source software, genomic medicine, clinical text mining
MeSH terms: United Kingdom, Hospitals, Humans, National Health Programs, Natural Language Processing, Information Storage and Retrieval, Electronic Health Records

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

CogStack - experiences of deploying integrated information retrieval and extraction services in a large National Health Service Foundation Trust hospital

Abstract

Overview

Integrity signals

Figures

Verification

Claims the paper makes

Claims other papers make about this one

Self-check

Citations

Cites

Cited by

Related

Metadata

Record

About these checks