Cited by 369Meta-analysis and systematic reviewsMedical Coding and Health InformationStatistical Methods in Epidemiology

The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.

Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data

Benchimol, Eric I., Manuel, Douglas G., To, Teresa, Griffiths, Anne M., Rabeneck, Linda, Guttmann, Astrid·2011·Journal of Clinical Epidemiology

DOI 10.1016/j.jclinepi.2010.10.006

Open this paper in CoChat — free account

Abstract

Background and objectives Validation of health administrative data for identifying patients with different health states (diseases and conditions) is a research priority, but no guidelines exist for ensuring quality. We created reporting guidelines for studies validating administrative data identification algorithms and used them to assess the quality of reporting of validation studies in the literature.Methods Using Standards for Reporting of Diagnostic accuracy (STARD) criteria as a guide, we created a 40-item checklist of items with which identification accuracy studies should be reported. A systematic review identified studies that validated identification algorithms using administrative data. We used the checklist to assess the quality of reporting.Results In 271 included articles, goals and data sources were well reported but few reported four or more statistical estimates of accuracy (36.9%). In 65.9% of studies reporting positive predictive value (PPV)/negative predictive value (NPV), the prevalence of disease in the validation cohort was higher than in the administrative data, potentially falsely elevating predictive values. Subgroup accuracy (53.1%) and 95% confidence intervals for accuracy measures (35.8%) were also underreported.Conclusions The quality of studies validating health states in the administrative data varies, with significant deficits in reporting of markers of diagnostic accuracy, including the appropriate estimation of PPV and NPV. These omissions could lead to misclassification bias and incorrect estimation of incidence and health services utilization rates. Use of a reporting checklist, such as the one created for this study by modifying the STARD criteria, could improve the quality of reporting of validation studies, allowing for accurate application of algorithms, and interpretation of research using health administrative data.

Integrity signals

Registry

Crossref · 10.1016/j.jclinepi.2010.10.006

Cites

33 of 33 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., Vandenbroucke, J. P., & Initiative, F. T. S. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040296 · Cited by 23,020
Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative.
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00010 · Cited by 3,219
Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · BMJ · doi:10.1136/bmj.326.7379.41 · Cited by 3,215
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies
von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2007) · Preventive Medicine · doi:10.1016/j.ypmed.2007.08.012 · Cited by 2,698
Statistics Notes: Diagnostic tests 2: predictive values
Altman, D. G., & Bland, J. M. (1994) · BMJ · doi:10.1136/bmj.309.6947.102 · Cited by 1,711
Diabetes in Ontario
Hux, J. E., Ivis, F. J., Flintoft, V. F., & Bica, A. (2002) · Diabetes Care · doi:10.2337/diacare.25.3.512 · Cited by 1,290
The CONSORT Statement
Cha, M., Eastwaad, S., Hartan, R., Maher, D., Olkin, I., Pitkin, R., Rennie, D., Schulz, K. F., Simel, D. L., & Straup, D. F. (1996) · Cited by 736
Epidemiology of Crohn's Disease and Ulcerative Colitis in a Central Canadian Province: A Population-based Study
Bernstein, C. N., Blanchard, J., Rawsthorne, P. E., & Wajda, A. (1999) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009735 · Cited by 661
Medical Subject Headings
ROGERS, F. B. (1965) · Nature · doi:10.1038/205236a0 · Cited by 571

Show all 32 references

Sorted by citations

Items 101–200 of 369

Validating mortality in the German Pharmacoepidemiological Research Database (GePaRD) against a mortality registry
Ohlmeier, C., Langner, I., Garbe, E., & Riedel, O. (2016) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4005 · Cited by 26
Validity of early-onset dementia diagnoses in VA electronic medical record administrative data
Marceaux, J. C., Soble, J. R., O’Rourke, J. J. F., Swan, A. A., Wells, M., Amuan, M. E., Sagiraju, H. K. R., Eapen, B. C., & Pugh, M. J. (2019) · The Clinical Neuropsychologist · doi:10.1080/13854046.2019.1679889 · Cited by 26
Is there an agreement between self-reported medical diagnosis in the CARTaGENE cohort and the Québec administrative health databases?
Payette, Y., de Moura, C. S., Boileau, C., Bernatsky, S., & Noisel, N. (2020) · International Journal for Population Data Science · doi:10.23889/ijpds.v5i1.1155 · Cited by 26
Validation of 5 key colonoscopy-related data elements from Ontario health administrative databases compared to the clinical record: a cross-sectional study
Tinmouth, J., Sutradhar, R., Liu, N., Baxter, N. N., Paszat, L. F., & Rabeneck, L. (2018) · CMAJ Open · doi:10.9778/cmajo.20180013 · Cited by 25
Self-citation
The Canadian Assisted Reproductive Technologies Register (CARTR) Plus database: a validation study
Bacal, V., Fell, D. B., Shapiro, H. M., Lanes, A., Sprague, A. E., Johnson, M., WALKER, M. C., & Gaudet, L. (2020) · Human Reproduction Open · doi:10.1093/hropen/hoaa005 · Cited by 26
Identification of congenital CMV cases in administrative databases and implications for monitoring prevalence, healthcare utilization, and costs
Grosse, S. D., Leung, J. W. T., & Lanzieri, T. M. (2021) · Current Medical Research and Opinion · doi:10.1080/03007995.2021.1890556 · Cited by 25
The accuracy of burn diagnosis codes in health administrative data: A validation study
Mason, S. A., Nathens, A. B., Byrne, J. P., Fowler, R. A., Gonzalez, A. J., Karanicolas, P. J., Moineddin, R., & Jeschke, M. G. (2017) · Burns · doi:10.1016/j.burns.2016.11.008 · Cited by 24
Use of physician billing claims to identify infections in children
Hwee, J., Sung, L., Kwong, J. C., Sutradhar, R., Tu, K., & Pole, J. D. (2018) · PLoS ONE · doi:10.1371/journal.pone.0207468 · Cited by 24
International Classification of Diseases Codes are Useful in Identifying Cirrhosis in Administrative Databases
Dahiya, M., Eboreime, E., Hyde, A. M., Rahman, S., Sebastianski, M., Carbonneau, M., Tapper, E. B., & Tandon, P. (2021) · Digestive Diseases and Sciences · doi:10.1007/s10620-021-07076-1 · Cited by 24
Electronic Health Records in Mental Health Research: A Framework for Developing Valid Research Methods
Castillo, E. G., Olfson, M., Pincus, H. A., Vawdrey, D. K., & Stroup, T. S. (2014) · Psychiatric Services · doi:10.1176/appi.ps.201400200 · Cited by 23
Identification of Pediatric Autism Spectrum Disorder Cases Using Health Administrative Data
Bickford, C., Oberlander, T. F., Lanphear, N. E., Weikum, W., Janssen, P. A., Ouellette-Kuntz, H. M. J., & Hanley, G. E. (2019) · Autism Research · doi:10.1002/aur.2252 · Cited by 27
An administrative data algorithm to identify traumatic spinal cord injured patients: a validation study
Welk, B. K., Loh, E., Shariff, S. Z., Liu, K., & Siddiqi, F. (2013) · Spinal Cord · doi:10.1038/sc.2013.134 · Cited by 24
ADHD and Neurodegenerative Disease Risk: A Critical Examination of the Evidence
Becker, S., Sharma, M. J., & Callahan, B. L. (2022) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2021.826213 · Cited by 25
The Certainty Framework for Assessing Real‐World Data in Studies of Medical Product Safety and Effectiveness
Cocoros, N. M., Arlett, P. R., Dreyer, N. A., Ishiguro, C., Iyasu, S., Sturkenboom, M., Zhou, W., & Toh, S. (2020) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.2045 · Cited by 25
The validity of pediatric cancer diagnoses in a population-based general cancer registry in Ontario, Canada
Gupta, S., & Pole, J. D. (2016) · BMC Cancer · doi:10.1186/s12885-016-2931-8 · Cited by 22
Identifying incident Parkinson's disease using administrative diagnostic codes: a validation study
Peterson, B. J., Rocca, W. A., Bower, J. H., Savica, R., & Mielke, M. M. (2020) · Clinical Parkinsonism & Related Disorders · doi:10.1016/j.prdoa.2020.100061 · Cited by 22
Accuracy of administrative database algorithms for autism spectrum disorder, attention-deficit/hyperactivity disorder and fetal alcohol spectrum disorder case ascertainment: a systematic review
O’Donnell, S. C., Palmeter, S., Laverty, M., & Lagacé, C. (2022) · Health Promotion and Chronic Disease Prevention in Canada · doi:10.24095/hpcdp.42.9.01 · Cited by 24
Accuracy of colorectal cancer ICD-9-CM codes in Italian administrative healthcare databases: a cross-sectional diagnostic study
Cozzolino, F., Bidoli, E., Abraha, I., Fusco, M., Giovannini, G., Casucci, P., Orso, M., Granata, A., Giorgi, M. D., Collarile, P., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-020630 · Cited by 22
Validity of diagnostic codes and laboratory measurements to identify patients with idiopathic acute liver injury in a hospital database
Udo, R., der Zee, A. H. M., Egberts, T. C. G., den Breeijen, J. H., Leufkens, H. G. M., van Solinge, W. W., & Bruin, M. L. D. (2015) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.3824 · Cited by 21
Validation of algorithms to determine incidence of Hirschsprung disease in Ontario, Canada: a population-based study using health administrative data
Nasr, A., Sullivan, K., Chan, E., Wong, C. A., & Benchimol, E. I. (2017) · Clinical Epidemiology · doi:10.2147/clep.s148890 · Cited by 20
Self-citation
Validation of chronic obstructive pulmonary disease (COPD) diagnoses in healthcare databases: a systematic review protocol
Rimland, J. M., Abraha, I., Luchetta, M. L., Cozzolino, F., Orso, M., Cherubini, A., Dell’Aquila, G., Chiatti, C., Ambrosio, G., & Montedori, A. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011777 · Cited by 20
Appropriateness of End-of-Life Care in People Dying With Dementia: Applying Quality Indicators on Linked Administrative Databases
Schreye, R. D., Smets, T., Deliëns, L., Annemans, L., Gielen, B., & Cohen, J. (2020) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2019.12.020 · Cited by 20
Validity of Algorithms for Identification of Individuals Suffering from Chronic Noncancer Pain in Administrative Databases: A Systematic Review
Lacasse, A., Charest, E. C., Dault, R., Cloutier, A., Choinière, M., Blais, L., & Vanasse, A. (2020) · Pain Medicine · doi:10.1093/pm/pnaa004 · Cited by 25
Incidence and prevalence of Parkinson’s disease in the Italian region of Umbria: a population-based study using healthcare administrative databases
Eusebi, P., Franchini, D., Giorgi, M. D., Abraha, I., Montedori, A., Casucci, P., Calabresi, P., & Tambasco, N. (2019) · Neurological Sciences · doi:10.1007/s10072-019-03872-w · Cited by 20
Pitfalls and Perils of Using Administrative Databases to Evaluate the Incidence of Inflammatory Bowel Disease Overtime
Kaplan, G. G. (2014) · Inflammatory Bowel Diseases · doi:10.1097/mib.0000000000000161 · Cited by 20
Secondary use of routinely collected administrative health data for epidemiologic research: Answering research questions using data collected for a different purpose
Emerson, S. D., McLinden, T., Sereda, P., Yonkman, A. M., Trigg, J., Peterson, S., Hogg, R. S., Salters, K. A., Lima, V. D., & Barrios, R. (2024) · International Journal for Population Data Science · doi:10.23889/ijpds.v9i1.2407 · Cited by 30
Validation of a Case Definition for Pediatric Brain Injury Using Administrative Data
Mcchesney-Corbeil, J., Barlow, K. M., Quan, H., Chen, G., Wiebe, S., & Jetté, N. (2017) · Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques · doi:10.1017/cjn.2016.419 · Cited by 19
Validity of International Classification of Diseases Codes for Identifying Neuro-Ophthalmic Disease in Large Data Sets: A Systematic Review
Hamedani, A. G., De Lott, L. B., Deveney, T., & Moss, H. E. (2020) · Journal of Neuro-Ophthalmology · doi:10.1097/wno.0000000000000971 · Cited by 19
What Does “Palliative Care” Represent in Research Using Secondary Data?
Cassel, J. B. (2024) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2024.07.011 · Cited by 19
Protocol for validating cardiovascular and cerebrovascular ICD-9-CM codes in healthcare administrative databases: the Umbria Data Value Project
Cozzolino, F., Abraha, I., Orso, M., Mengoni, A., Cerasa, M. F., Eusebi, P., Ambrosio, G., & Montedori, A. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013785 · Cited by 19
Comparing prescribing and dispensing databases to study antibiotic use: a validation study of the Electronic Medical Record Administrative data Linked Database (EMRALD)
Schwartz, K. L., Wilton, A. S., Langford, B. J., Brown, K. A., Daneman, N., Garber, G. E., Johnstone, J., Adomako, K., Achonu, C., & Tu, K. (2019) · Journal of Antimicrobial Chemotherapy · doi:10.1093/jac/dkz033 · Cited by 18
Influencia De La Inteligencia Artificial En La Medicina
Abraha, I., Orso, M., Grilli, P., Cozzolino, F., Eusebi, P., Casucci, P., Marchesi, M., Luchetta, M. L., Fruttini, L., Ciappelloni, R., et al. (2014) · International Journal of Statistics in Medical Research · doi:10.6000/1929-6029.2014.03.03.10 · Cited by 18
Validity of ICD-9-CM codes for breast, lung and colorectal cancers in three Italian administrative healthcare databases: a diagnostic accuracy study protocol
Abraha, I., Serraino, D., Giovannini, G., Stracci, F., Casucci, P., Alessandrini, G., Bidoli, E., Chiari, R., Cirocchi, R., Giorgi, M. D., et al. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010547 · Cited by 18
Identification of prosthetic hip and knee joint infections using administrative databases—A validation study
Kandel, C. E., Jenkinson, R., Widdifield, J., Hansen, B. E., Davey, J. R., Muller, M. P., Daneman, N., & McGeer, A. (2020) · Infection Control and Hospital Epidemiology · doi:10.1017/ice.2020.449 · Cited by 18
Identification of dementia and MCI cases in health information systems: An Italian validation study
Bacigalupo, I., Lombardo, F. L., Bargagli, A. M., Cascini, S., Agabiti, N., Davoli, M., Scalmana, S., Palma, A. D., Greco, A., Rinaldi, M., et al. (2022) · Alzheimer s & Dementia Translational Research & Clinical Interventions · doi:10.1002/trc2.12327 · Cited by 17
Prevalence and Incidence Trends of Attention Deficit/Hyperactivity Disorder in Children and Youth Aged 1–24 Years in Ontario, Canada: A Validation Study of Health Administrative Data Algorithms: Tendances de la prévalence et de l’incidence du trouble de déficit de l’attention/hyperactivité chez les enfants et les jeunes âgés de 1 à 24 ans, en Ontario, Canada: une étude de validation des algorithmes de données administratives de santé
Butt, D. A., Jaakkimainen, L., & Tu, K. (2023) · The Canadian Journal of Psychiatry · doi:10.1177/07067437231213553 · Cited by 25
Validity of Administrative Data in Identifying Cancer-related Events in Adolescents and Young Adults
Gupta, S., Nathan, P. C., Baxter, N. N., Lau, C., Daly, C., & Pole, J. D. (2017) · Medical Care · doi:10.1097/mlr.0000000000000777 · Cited by 18
Identifying pediatric diabetes cases from health administrative data: a population-based validation study in Quebec, Canada
Nakhla, M. M., Simard, M., Dubé, M., Larocque, I., Plante, C., Legault, L., Huot, C., Gagné, N., Gagné, J., Wafa, S., et al. (2019) · Clinical Epidemiology · doi:10.2147/clep.s217969 · Cited by 18
Self-citation
Disease misclassification in electronic healthcare database studies: Deriving validity indices—A contribution from the ADVANCE project
Bollaerts, K., Rekkas, A., Smedt, T. D., Dodd, C. N., Andrews, N. J., & Gini, R. (2020) · PLoS ONE · doi:10.1371/journal.pone.0231333 · Cited by 19
Validity of the diagnosis of appendicitis in the Danish National Patient Register
Kleif, J., Thygesen, L. C., & Gögenür, I. (2018) · Scandinavian Journal of Public Health · doi:10.1177/1403494818761765 · Cited by 17
Identifying chronic thromboembolic pulmonary hypertension through the French national hospital discharge database
Cottin, V., Avot, D., Lévy-Bachelot, L., Baxter, C. A., Ramey, D. R., Catella, L., Bénard, S., Sitbon, O., & Teal, S. (2019) · PLoS ONE · doi:10.1371/journal.pone.0214649 · Cited by 17
Explanation and Elaboration of the Standards of Reporting of Neurological Disorders Checklist: A Guideline for the Reporting of Incidence and Prevalence Studies in Neuroepidemiology
Bennett, D., Brayne, C., Feigin, V. L., Barker-Collo, S. L., Brainin, M., Davis, D. H. J., Gallo, V., Jetté, N., Karch, A., Kurtzke, J. F., et al. (2015) · Neuroepidemiology · doi:10.1159/000439132 · Cited by 17
Validation study of bullous pemphigoid and pemphigus vulgaris recording in routinely collected electronic primary healthcare records in England
Persson, M. S. M., Harman, K. E., Vinogradova, Y., Langan, S., Hippisley‐Cox, J., Thomas, K. S., & Gran, S. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-035934 · Cited by 17
Risk of neurodegenerative disease or dementia in adults with attention-deficit/hyperactivity disorder: a systematic review
Becker, S., Chowdhury, M., Tavilsup, P., Seitz, D. P., & Callahan, B. L. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1158546 · Cited by 16
Sensitivity and specificity of breast cancer ICD-9-CM codes in three Italian administrative healthcare databases: a diagnostic accuracy study
Abraha, I., Serraino, D., Montedori, A., Fusco, M., Giovannini, G., Casucci, P., Cozzolino, F., Orso, M., Granata, A., Giorgi, M. D., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-020627 · Cited by 16
Towards a national perioperative clinical quality registry: The diagnostic accuracy of administrative data in identifying major postoperative complications
Reilly, J. R., Shulman, M. A., Gilbert, A., Jomon, B., Thompson, R. J., Nicholson, J. J., Burke, J. A., Lehane, D. N., Liaw, C.-M., Mahoney, A. J., et al. (2020) · Anaesthesia and Intensive Care · doi:10.1177/0310057x20905606 · Cited by 16
A review of routinely collected data studies in urology: Methodological considerations, reporting quality, and future directions
Welk, B. K., & Kwong, J. (2017) · Canadian Urological Association Journal · doi:10.5489/cuaj.4101 · Cited by 16
Validation of an algorithm to identify children with biopsy-proven celiac disease from within health administrative data: An assessment of health services utilization patterns in Ontario, Canada
Chan, J., Mack, D. R., Manuel, D. G., Mojaverian, N., de Nanassy, J., & Benchimol, E. I. (2017) · PLoS ONE · doi:10.1371/journal.pone.0180338 · Cited by 16
Self-citation
Assessing the Validity of Claims-Based Diagnostic Codes for Psychotic and Affective Disorders and the Influence of the Coding Transition from the ICD-9 to the ICD-10 in Taiwan’s National Health Insurance Research Database
Wang, Y.-W., Liu, C., Chen, H., Wu, C., Chan, J.-H., Chen, C., Huang, W., Liao, S., Hwang, T., & Chen, W. J. (2025) · Clinical Epidemiology · doi:10.2147/clep.s522618 · Cited by 15
Validity of breast, lung and colorectal cancer diagnoses in administrative databases: a systematic review protocol
Abraha, I., Giovannini, G., Serraino, D., Fusco, M., & Montedori, A. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010409 · Cited by 15
A Validation of Hysterectomy Procedural Codes in the Canadian Institute for Health Information Discharge Abstract Database
Bacal, V., Payne, M., Nguyen, V., Baier, K., Gratton, S.-M., Khair, S., Médor, M. C., Mercier, S. L., Choudhry, A. J., & Chen, I. (2021) · Journal of Obstetrics and Gynaecology Canada · doi:10.1016/j.jogc.2021.10.018 · Cited by 15
Case-Ascertainment Models to Identify Adults with Obstructive Sleep Apnea Using Health Administrative Data: Internal and External Validation
Kendzerska, T., van Walraven, C., McIsaac, D. I., Povitz, M., Mulpuru, S., Lima, I. S. F., Talarico, R., Aaron, S. D., Reisman, W. M., & Gershon, A. S. (2021) · Clinical Epidemiology · doi:10.2147/clep.s308852 · Cited by 15
Validation to correct for outcome misclassification bias
Lanes, S., & Beachler, D. C. (2023) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.5601 · Cited by 15
The prevalence of systemic autoimmune rheumatic diseases in Canadian pediatric populations: administrative database estimates
Shiff, N. J., Lix, L. M., Joseph, L., Duffy, C. M., Tucker, L. B., Svenson, L. W., Bélisle, P., & Bernatsky, S. (2014) · Rheumatology International · doi:10.1007/s00296-014-3136-6 · Cited by 15
Algorithm for analysis of administrative pediatric cancer hospitalization data according to indication for admission
Russell, H. V., Okcu, M. F., Kamdar, K. Y., Shah, M. D., Kim, E. S., Swint, J. M., Chan, W., Du, X. L., Franzini, L., & Ho, V. (2014) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-14-88 · Cited by 15
Chronic inflammatory arthritis prevalence estimates for children and adolescents in three Canadian provinces
Shiff, N. J., Lix, L. M., Oen, K., Joseph, L., Duffy, C. M., Stringer, E., Tucker, L. B., Svenson, L. W., Bélisle, P., & Bernatsky, S. (2014) · Rheumatology International · doi:10.1007/s00296-014-3085-0 · Cited by 15
Bias from outcome misclassification in immunization schedule safety research
Newcomer, S. R., Kulldorff, M., Xu, S., Daley, M. F., FIREMAN, B. H., Lewis, E. M., & Glanz, J. M. (2018) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4374 · Cited by 15
Reporting Guidelines
Popham, K., Calo, W. A., Carpentier, M. Y., Chen, N. E., Kamrudin, S. A., Le, Y. L., Skala, K. A., Thornton, L. R., & Mullen, P. D. (2012) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2012.06.031 · Cited by 15
Identifying cases of chronic pain using health administrative data: A validation study
Foley, H. E., KNIGHT, J. C., Ploughman, M., Asghari, S., & Audas, R. (2020) · Canadian Journal of Pain · doi:10.1080/24740527.2020.1820857 · Cited by 14
Excess Mortality Among Assisted Living Residents With Dementia During the COVID-19 Pandemic
Hua, C. L., Cornell, P. Y., Zimmerman, S. I., Carder, P., & Thomas, K. S. (2022) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2022.07.023 · Cited by 14
Validation of case-ascertainment algorithms using health administrative data to identify people who inject drugs in Ontario, Canada
Greenwald, Z. R., Werb, D., Feld, J. J., Austin, P. C., Fridman, D. J., Bayoumi, A. M., Gomes, T., Kendall, C., Lapointe‐Shaw, L., Scheim, A. I., et al. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111332 · Cited by 14
Self-citation
Le Système intégré de surveillance des maladies chroniques du Québec (SISMACQ), une approche novatrice
Blais, C., Jean, S., Sirois, C., Rochette, L., Plante, C., Larocque, I., Doucet, M., Ruel, G., Simard, M., Gamache, P., et al. (2014) · Maladies chroniques et blessures au Canada · doi:10.24095/hpcdp.34.4.06f · Cited by 14
Validation studies in epidemiologic research: estimation of the positive predictive value
Schelde, A. B., & Kornholt, J. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.05.009 · Cited by 14
The impact of paradoxical comorbidities on risk-adjusted mortality of Medicare beneficiaries with cardiovascular disease
Vaughan‐Sarrazin, M., Lu, X., & Cram, P. M. (2011) · Medicare & Medicaid Research Review · doi:10.5600/mmrr.001.03.a02 · Cited by 14
Disparities in diabetes-related preventable hospitalizations among working-age Native Hawaiians and Asians in Hawai'i.
Sentell, T. L., Juarez, D. T., Ahn, H. J., Tseng, C., Chen, J. J., Salvail, F. R., Miyamura, J., & Mau, M. K. L. M. (2014) · PubMed Central · Cited by 14
Accuracy of lung cancer ICD-9-CM codes in Umbria, Napoli 3 Sud and Friuli Venezia Giulia administrative healthcare databases: a diagnostic accuracy study
Montedori, A., Bidoli, E., Serraino, D., Fusco, M., Giovannini, G., Casucci, P., Franchini, D., Granata, A., Ciullo, V., Vitale, M. F., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-020628 · Cited by 14
Evaluation of reporting quality for observational studies using routinely collected health data in pharmacovigilance
Nie, X., Zhang, Y., Wu, Z., Jia, L., Wang, X., Langan, S., Benchimol, E. I., & Peng, X. (2018) · Expert Opinion on Drug Safety · doi:10.1080/14740338.2018.1484106 · Cited by 14
Self-citation
Linking Individual Patient Data to Estimate Incidence and Prevalence of Parkinson's Disease by Comparing Reports of Neurological Services and Pharmacy Prescription Refills at a Nationwide Level
Szatmári, S., Ajtay, A., Bálint, M., Takáts, A., Oberfrank, F., & Bereczki, D. (2019) · Frontiers in Neurology · doi:10.3389/fneur.2019.00640 · Cited by 14
Identification of homelessness using health administrative data in Ontario, Canada following a national coding mandate: a validation study
Richard, L., Carter, B., Nisenbaum, R. A., Liu, M., & Hwang, S. W. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2024.111430 · Cited by 13
Positive Predictive Values of International Classification of Diseases, 10th Revision Coding Algorithms to Identify Patients With Autosomal Dominant Polycystic Kidney Disease
Kalatharan, V., Pei, Y., Clemens, K. K., McTavish, R. K., Dixon, S. N., Rochon, M., Nash, D. M., Jain, A. K., Sarma, S., Zaleski, A., et al. (2016) · Canadian Journal of Kidney Health and Disease · doi:10.1177/2054358116679130 · Cited by 13
Changes in Soft-Tissue Sarcoma Treatment Patterns over Time: A Population-Based Study in a Country with Universal and Centralized Healthcare
Bozzo, A., Seow, H. Y., Pond, G. R., & Ghert, M. A. (2019) · Sarcoma · doi:10.1155/2019/8409406 · Cited by 13
Development of algorithms for identifying patients with Crohn’s disease in the Japanese health insurance claims database
Morikubo, H., Kobayashi, T., Fukuda, T., Nagahama, T., Hisamatsu, T., & Hibi∥, T. (2021) · PLoS ONE · doi:10.1371/journal.pone.0258537 · Cited by 13
Are pregnancy outcomes associated with risk factor reporting in routinely collected perinatal data?
Ampt, A. J., Ford, J. B., Taylor, L. K., & Roberts, C. L. (2013) · New South Wales Public Health Bulletin · doi:10.1071/nb12116 · Cited by 12
Validity of peptic ulcer disease and upper gastrointestinal bleeding diagnoses in administrative databases: a systematic review protocol
Montedori, A., Abraha, I., Chiatti, C., Cozzolino, F., Orso, M., Luchetta, M. L., Rimland, J. M., & Ambrosio, G. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-011776 · Cited by 12
Validating malignant melanoma ICD-9-CM codes in Umbria, ASL Napoli 3 Sud and Friuli Venezia Giulia administrative healthcare databases: a diagnostic accuracy study
Orso, M., Serraino, D., Abraha, I., Fusco, M., Giovannini, G., Casucci, P., Cozzolino, F., Granata, A., Gobbato, M., Stracci, F., et al. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-020631 · Cited by 12
Comparing Health Administrative and Clinical Registry Data: Trends in Incidence and Prevalence of Pediatric Inflammatory Bowel Disease in British Columbia
Chan, J. M., Carroll, M. W., Smyth, M. D., Hamilton, Z., Evans, D., McGrail, K. M., Benchimol, E. I., & Jacobson, K. (2021) · Clinical Epidemiology · doi:10.2147/clep.s292546 · Cited by 12
Self-citation
Validation of a proxy for estrogen receptor status in breast cancer patients using dispensing data
Srasuebkul, P., Dobbins, T., Elements of Cancer Care (EoCC) Investigators, & Pearson, S. (2012) · Asia-Pacific Journal of Clinical Oncology · doi:10.1111/ajco.12015 · Cited by 12
Identification of Early Onset Dementia in Population-Based Health Administrative Data: A Validation Study Using Primary Care Electronic Medical Records
Jaakkimainen, L., Duchen, R., Lix, L. M., Al‐Azazi, S., Yu, B., Butt, D. A., Park, S., & Widdifield, J. (2022) · Journal of Alzheimer s Disease · doi:10.3233/jad-220384 · Cited by 11
Diagnostic accuracy of algorithms to define incident and second hip fractures: A Taiwan validation study
Fu, S., Yu, P.-Y., Li, C., Hung, C., Lee, C., Chen, H., Tai, T., Hwang, J., Yang, R., Chiang, H., et al. (2023) · Journal of the Formosan Medical Association · doi:10.1016/j.jfma.2023.05.037 · Cited by 11
Validation and comparison of the coding algorithms to identify people with migraine using Japanese claims data
Yamato, K., Sano, H., Hirata, K., & Nakayama, T. (2023) · Frontiers in Neurology · doi:10.3389/fneur.2023.1231351 · Cited by 11
Validating registry data on statins prescriptions by blood measurements
Riis, A. H., Erichsen, R., Ostenfeld, E. B., Højskov, C. S., Thorlacius‐Ussing, O., Stender, M. T., Lash, T. L., & Møller, H. J. (2019) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4700 · Cited by 11
Validation of algorithms for selecting rheumatoid arthritis patients in the Tuscan healthcare administrative databases
Convertino, I., Cazzato, M., Giometto, S., Gini, R., Valdiserra, G., Cappello, E., Ferraro, S., Tillati, S., Bartolini, C., Paoletti, O., et al. (2021) · Scientific Reports · doi:10.1038/s41598-021-98321-0 · Cited by 11
Development and validation of a protocol for documentation of obstetric perineal lacerations
Jansson, M. H., Nilsson, K., & Franzén, K. (2019) · International Urogynecology Journal · doi:10.1007/s00192-019-03915-y · Cited by 11
Utility of medical record diagnostic codes to ascertain attention-deficit/hyperactivity disorder and learning disabilities in populations of children
Shi, Y., Schulte, P. J., Hanson, A. C., Zaccariello, M. J., Hu, D., Crow, S. S., Flick, R. P., & Warner, D. O. (2020) · BMC Pediatrics · doi:10.1186/s12887-020-02411-3 · Cited by 11
Validation of a claims‐based algorithm to identify cases of ulcerative colitis in Japan
Ogino, H., Morikubo, H., Fukaura, K., Okui, T., Gardiner, S. M., Sugiyama, N., Yoshii, N., Kawaguchi, T., Chen, H., Nonnenmacher, E., et al. (2021) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.15732 · Cited by 11
Reporting and Transparency in Big Data: The Nexus of Ethics and Methodology
Nicholls, S. G., Langan, S., & Benchimol, E. I. (2016) · Law, governance and technology series · doi:10.1007/978-3-319-33525-4_15 · Cited by 12
Self-citation
Accuracy of Algorithms to Identify People with Atopic Dermatitis in Ontario Routinely Collected Health Databases
Abdalla, M., Chen, B., Santiago, R., Young, J., Eder, L., Chan, A., Pope, E., Tu, K., Jaakkimainen, L., & Drucker, A. M. (2021) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2021.01.009 · Cited by 10
Systematic review of validated case definitions to identify hypertensive disorders of pregnancy in administrative healthcare databases
Johnston, A., Dancey, S. R., Tseung, V., Skidmore, B., Tanuseputro, P., Smith, G. N., Coutinho, T. A., & Edwards, J. D. (2023) · Open Heart · doi:10.1136/openhrt-2022-002151 · Cited by 10
Identification of people with low prevalence diseases in administrative healthcare records: A case study of HIV in British Columbia, Canada
Emerson, S. D., McLinden, T., Sereda, P., Lima, V. D., Hogg, R. S., Kooij, K. W., Yonkman, A. M., Salters, K. A., Moore, D. M., Toy, J., et al. (2023) · PLoS ONE · doi:10.1371/journal.pone.0290777 · Cited by 10
Surveillance of catheter-associated bloodstream infections: development and validation of a fully automated algorithm
Catho, G., Fortchantre, L., Teixeira, D., Galas-Haddad, M., Boroli, F., Chraïti, M., Abbas, M., Harbarth, S., Buetti, N., Swissnoso group, et al. (2024) · Antimicrobial Resistance and Infection Control · doi:10.1186/s13756-024-01395-4 · Cited by 10
A comparison of self-reported oral contraceptive use and automated pharmacy data in perimenopausal and early postmenopausal women
Spangler, L., Ichikawa, L., Hubbard, R. A., Operskalski, B. H., LaCroix, A. Z., Ott, S. M., & Scholes, D. (2014) · Annals of Epidemiology · doi:10.1016/j.annepidem.2014.10.009 · Cited by 10
Validating an algorithm for multiple myeloma based on administrative data using a SEER tumor registry and medical record review
Brandenburg, N. A., Phillips, S., Wells, K. E., Woodcroft, K. J., Amend, K. L., Enger, C. L., & Oliveria, S. A. (2019) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.4711 · Cited by 10
Public health and epidemiology of cancer in Colombia
Wiesner, C. (2018) · Colombia medica · doi:10.25100/cm.v49i1.3885 · Cited by 10
A Systematic Review to Inform the Development of a Reporting Guideline for Concept Mapping Research
Pantha, S., Jones, M., Gartoulla, P., & Gray, R. J. (2023) · Methods and Protocols · doi:10.3390/mps6050101 · Cited by 9
A kórházi adatlapok jelentéseinek alkalmazhatósága epidemiológiai elemzésekre az ischaemiás cerebrovascularis betegségek példája alapján
Ajtay, A., Oberfrank, F., & Bereczki, D. (2015) · Orvosi Hetilap · doi:10.1556/650.2015.30258 · Cited by 9
Common and Costly Hospitalizations Among Insured Young Adults Since the Affordable Care Act
Bain, A. M., Wong, C. A., Slap, G. B., Polsky, D. E., Merchant, R. M., Antwi, Y. A., Rubin, D. M., & Ford, C. A. (2016) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2016.03.013 · Cited by 9
Identification of irritable bowel syndrome in the Swedish National Patient Register: a validation study
Tornkvist, N. T., Backman, A.-S., Linder, M., Altman, M., Simrén, M., Olén, O., & Törnblom, H. (2023) · Scandinavian Journal of Gastroenterology · doi:10.1080/00365521.2023.2173021 · Cited by 9
The burden of diagnosed and undiagnosed diabetes in Native Hawaiian and Asian American hospitalized patients
Sentell, T. L., Cheng, Y., Saito, E., Seto, T. B., Miyamura, J., Mau, M. K. L. M., & Juarez, D. (2015) · Journal of Clinical & Translational Endocrinology · doi:10.1016/j.jcte.2015.08.002 · Cited by 9
Development and validation of lupus nephritis case definitions using United States veterans affairs electronic health records
Li, T., Lee, I., Jayakumar, D., Huang, X., Xie, Y., Eisen, S. A., & Ranganathan, P. (2020) · Lupus · doi:10.1177/0961203320973267 · Cited by 8
The Accuracy of Japanese Administrative Data in Identifying Acute Exacerbation of Idiopathic Pulmonary Fibrosis
Anan, K., Kataoka, Y., Ichikado, K., Kawamura, K., Johkoh, T., Fujimoto, K., Tobino, K., Tachikawa, R., Ito, H., Nakamura, T., et al. (2022) · Annals of Clinical Epidemiology · doi:10.37737/ace.22008 · Cited by 8

Authors: Benchimol, E. I., Manuel, D. G., To, T., Griffiths, A. M., Rabeneck, L., & Guttmann, A.
Affiliations: University of Ottawa (CA)
Statistics Canada (CA)
University of Toronto (CA)
Corresponding author: Benchimol, Eric I.
ORCID: Benchimol, Eric I.
Manuel, Douglas G.
To, Teresa
Griffiths, Anne M.
Rabeneck, Linda
Guttmann, Astrid
Venue: Journal of Clinical Epidemiology
Publisher: Elsevier BV
Published: 2011-08
Volume: 64
Issue: 8
Pages: 821-829
ISSN: 0895-4356 (ISSN-L)
DOI: 10.1016/j.jclinepi.2010.10.006
OpenAlex: W1979334594
Cited by: 368
References: 32
Citations by year: 2026: 20 · 2025: 13 · 2024: 25 · 2023: 29 · 2022: 21 · 2021: 30 · 2020: 28 · 2019: 40 · 2018: 27 · 2017: 27 · 2016: 27 · 2015: 21 · 2014: 25 · 2013: 16 · 2012: 14
FWCI: 2.92
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
www.elsevier.com/legal/tdmrep-license (tdm)
Locations: Journal of Clinical Epidemiology (publishedVersion)
PubMed (publishedVersion)
Funders: American College of Gastroenterology
Child and Family Research Institute
Public Health Agency of Canada
Canadian Child Health Clinician Scientist Program
Hospital for Sick Children
Institut pour la Recherche en Santé Publique
Canadian Institutes of Health Research
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Keywords: administrative health data, data validation, identification algorithm, reporting guidelines, reporting quality, diagnostic accuracy, positive predictive value, negative predictive value, misclassification bias, disease prevalence, incidence estimation, health care utilization
MeSH terms: Algorithms, Forms and Records Control, Health Services Research, Health Status, Hospital Records, Humans, Quality Control, Guidelines as Topic, International Classification of Diseases, Validation Studies as Topic, Translational Research, Biomedical, Checklist

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks