Key Concepts to Assess the Readiness of Data for International Research: Data Quality, Lineage and Provenance, Extraction and Processing Errors, Traceability, and Curation: Contribution of the IMIA Primary Health Care Informatics Working Group
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Summary: To define the key concepts which inform whether a system for collecting, aggregating and processing routine clinical data for research is fit for purpose. Literature review and shared experiential learning from research using routinely collected data. We excluded socio-cultural issues, and privacy and security issues as our focus was to explore linking clinical data. Six key concepts describe data: (1) Data quality: the core Overarching concept – Are these data fit for purpose? (2) Data provenance: defined as how data came to be; incorporating the concepts of lineage and pedigree. Mapping this process requires metadata. New variables derived during data analysis have their own provenance. (3) Data extraction errors and (4) Data processing errors, which are the responsibility of the investigator extracting the data but need quantifying. (5) Traceability: the capability to identify the origins of any data cell within the final analysis table essential for good governance, and almost impossible without a formal system of metadata; and (6) Curation: storing data and look-up tables in a way that allows future researchers to carry out further research or review earlier findings. There are common distinct steps in processing data; the quality of any metadata may be predictive of the quality of the process. Outputs based on routine data should include a review of the process from data origin to curation and publish information about their data provenance and processing method.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data linkage: a powerful research tool with potential problems
Bohensky, M. A., Jolley, D., Sundararajan, V., Evans, S., Pilcher, D. V., Scott, I., & Brand, C. A. (2010) · BMC Health Services Research · doi:10.1186/1472-6963-10-346 · Cited by 234
Diagnostic Difficulty and Error in Primary Care—A Systematic Review
Kostopoulou, O., Delaney, B. C., & Munro, C. W. (2008) · Family Practice · doi:10.1093/fampra/cmn071 · Cited by 200 · cited 1×
“(3) Decision support which either prompts for missing data or which suggest diagnoses [27].”
BackgroundIssues in multiple imputation of missing data for large general practice clinical databases
Marston, L., Carpenter, J. R., Walters, K. R., Morris, R. W., Nazareth, I., & Petersen, I. (2010) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1934 · Cited by 132 · cited 1×
“The data processing design has to take into account whether the analysis is using complete data, just coded data, or whether there is access to free text and taking into account missing data [44, 45].”
MethodDe Lusignan, S., Khunti, K., Belsey, J., Hattersley, A., Van Vlymen, J., Gallagher, H., Millett, C., Hague, N. J., Tomson, C., Harris, K., et al. (2010) · Diabetic Medicine · doi:10.1111/j.1464-5491.2009.02917.x · Cited by 122 · cited 1×
“(2) Use of data entry forms which either facilitate or mandate the collection of a partial or complete dataset [25], or structuring the record in a way that forces linkage between problem and therapy, often referred to as problem orientation [26].”
BackgroundMeasuring the Completeness and Currency of Codified Clinical Information
Williams, J. G. (2003) · Methods of Information in Medicine · doi:10.1055/s-0038-1634243 · Cited by 18
Cited by
Ethical and regulatory challenges of AI technologies in healthcare: A narrative review
Mennella, C., Maniscalco, U., De Pietro, G., & Esposito, M. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e26297 · Cited by 1,229
Hersh, W. R., Weiner, M. G., Embi, P. J., Logan, J. R., Payne, P. R. O., Bernstam, E. V., Lehmann, H. P., Hripcsak, G., Hartzog, T. H., Cimino, J. J., et al. (2013) · Medical Care · doi:10.1097/mlr.0b013e31829b1dbd · Cited by 567
Liaw, S. T., Rahimi, A., Ray, P., Taggart, J., Dennis, S., de Lusignan, S., Jalaludin, B., Yeo, A. E. T., & Talaei-Khoei, A. (2013) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.10.001 · Cited by 170
“his is compounded in international multicentre studies by he logistic difficulties and different levels of commitment to Q [103].”
BackgroundSelf-citationLiaw, S.-T., Liyanage, H., Kuziemsky, C., Terry, A. L., Schreiber, R., Jonnagaddala, J., & de Lusignan, S. (2020) · Yearbook of Medical Informatics · doi:10.1055/s-0040-1701980 · Cited by 76
“After consensus on relevance, ethical challenges were extracted and categorised using the conceptual framework across the entire data life cycle [12].”
BackgroundMethodSelf-citationA Traceability Framework to Enable Circularity in the Built Environment
Davari, S., Jaberi, M., Yousfi, A., & Poirier, E. (2023) · Sustainability · doi:10.3390/su15108278 · Cited by 32
Metadata
- Authors
- de Lusignan, S., Liaw, S.-T., Krause, P., Curcin, V., Vicente, M., Michalakidis, G., Agreus, L., Leysen, P., Shaw, N., & Mendis, K.
- Venue
- Yearbook of Medical Informatics
- Publisher
- Georg Thieme Verlag KG
- Published
- 2011-08
- Volume
- 20
- Issue
- 01
- Pages
- 112-120
- ISSN
- 0943-4747 (ISSN-L)
- 2364-0502
- OpenAlex
- W2207671015
- Cited by
- 47
- References
- 5
- FWCI
- 13.87
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Key Concepts to Assess the Readiness of Data for International Research: Data Quality, Lineage and Provenance, Extraction and Processing Errors, Traceability, and Curation: Contribution of the IMIA Primary Health Care Informatics Working Group. https://app.cochat.ai/papers/10.1055/s-0038-1638748
- The paper
- de Lusignan, S., Liaw, S.-T., Krause, P., Curcin, V., Vicente, M., Michalakidis, G., Agreus, L., Leysen, P., Shaw, N., & Mendis, K. (2011). Key Concepts to Assess the Readiness of Data for International Research: Data Quality, Lineage and Provenance, Extraction and Processing Errors, Traceability, and Curation: Contribution of the IMIA Primary Health Care Informatics Working Group. Yearbook of Medical Informatics. https://doi.org/10.1055/s-0038-1638748
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.